-- Logs begin at Wed 2022-08-31 08:58:38 UTC, end at Wed 2022-08-31 10:15:40 UTC. -- Aug 31 09:38:58.371993 dv-cinder-844961-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 09:38:58.382838 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 09:38:58.384845 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 09:38:58 2022] *** Aug 31 09:38:58.384845 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 09:38:58.384845 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 09:38:58.384845 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: nodename: dv-cinder-844961-2-iscsi Aug 31 09:38:58.384845 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: machine: x86_64 Aug 31 09:38:58.384845 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: clock source: unix Aug 31 09:38:58.384845 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: pcre jit disabled Aug 31 09:38:58.384845 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: detected number of CPU cores: 4 Aug 31 09:38:58.384845 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: current working directory: / Aug 31 09:38:58.384845 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: detected binary path: /usr/bin/uwsgi-core Aug 31 09:38:58.384845 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: your processes number limit is 47680 Aug 31 09:38:58.385531 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: your memory page size is 4096 bytes Aug 31 09:38:58.385531 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: detected max file descriptor number: 2048 Aug 31 09:38:58.385531 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: lock engine: pthread robust mutexes Aug 31 09:38:58.385531 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: thunder lock: enabled Aug 31 09:38:58.385531 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 09:38:58.385531 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 09:38:58.425679 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: Python main interpreter initialized at 0x561c268ce9c0 Aug 31 09:38:58.425679 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: python threads support enabled Aug 31 09:38:58.425679 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: your server socket listen backlog is limited to 100 connections Aug 31 09:38:58.425679 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: your mercy for graceful operations on workers is 90 seconds Aug 31 09:38:58.426090 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 09:38:58.426090 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: *** Operational MODE: preforking *** Aug 31 09:38:58.427372 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: *** uWSGI is running in multiple interpreter mode *** Aug 31 09:38:58.427372 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: spawned uWSGI master process (pid: 112132) Aug 31 09:38:58.427589 dv-cinder-844961-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 09:38:58.433019 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: spawned uWSGI worker 1 (pid: 112133, cores: 1) Aug 31 09:38:58.433019 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: spawned uWSGI worker 2 (pid: 112134, cores: 1) Aug 31 09:38:58.433019 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 09:38:59.098974 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 09:38:59.100911 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 09:39:00.209471 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:39:00.209471 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: from cryptography.utils import int_from_bytes Aug 31 09:39:00.210058 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:39:00.210058 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: from cryptography.utils import int_from_bytes Aug 31 09:39:00.211109 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:39:00.211109 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: from cryptography.utils import int_from_bytes Aug 31 09:39:00.211552 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:39:00.211552 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: from cryptography.utils import int_from_bytes Aug 31 09:39:02.748661 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 09:39:02.749244 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 09:39:02.749462 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 09:39:02.749823 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 09:39:02.750078 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 09:39:02.750462 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.750786 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.751105 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.751221 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 09:39:02.751570 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.751659 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 09:39:02.751732 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.751993 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 09:39:02.752106 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.752340 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.752445 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 09:39:02.752607 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 09:39:02.752694 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.752971 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.753073 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.753228 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.753321 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.753565 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.753653 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.753889 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844961-2-iscsi {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.754008 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.754903 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.755247 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.755395 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.755709 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.755862 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.755994 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.756117 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.756251 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.756374 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.756503 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.756627 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.756755 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.756879 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.757080 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.757294 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.757487 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844961-2-iscsi {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.758602 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.758749 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.758749 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.758983 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.759106 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.759233 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.759233 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.759470 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.759582 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.759749 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.759749 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.759992 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.760114 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.760240 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.760362 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.760491 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.760636 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.760766 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.760894 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.761018 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.761158 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844961-2-iscsi {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.761281 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.761424 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.761549 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.761682 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.761814 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.761943 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.762086 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.762208 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.762346 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.762473 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.762603 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.763104 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.763247 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.763369 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.763502 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.763639 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.763809 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844961-2-iscsi {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.763938 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.764129 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.764269 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.764444 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.764573 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.764760 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.764882 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.765131 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.765283 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.765476 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.765618 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.765786 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.765923 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.766097 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.766224 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.766416 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.766550 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.766722 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.766858 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.767027 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.767169 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.767292 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.767415 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.767569 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.767707 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.767894 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.768028 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.768215 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.768351 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.768536 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.768668 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.768790 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.768913 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.769051 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.769183 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.769315 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.769492 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.769667 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.770364 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.770615 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.770848 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.770964 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.771084 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.771311 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.771442 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.771619 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.771839 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.771965 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.772092 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.772223 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.772344 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.772470 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.772605 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.772754 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.772887 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.773247 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.774129 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.774281 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.774408 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.774539 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.774670 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.774795 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.774919 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.775051 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.775182 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.775307 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.775429 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.775551 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.775673 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.775810 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.775935 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.776069 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.776193 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.776325 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.776457 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.776581 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.776703 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.776837 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.776960 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.777086 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.777226 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.777356 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.777510 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.777510 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.777755 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.777878 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.778009 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.778141 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.778264 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.778387 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.778509 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.778633 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.778766 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.778890 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.779014 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.779142 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.779272 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.779401 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.779536 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.779664 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.779811 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.779961 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.780121 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.780258 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.780434 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.780561 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.780759 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.780893 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.781126 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.781275 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.781429 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.781554 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.781688 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.781813 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.781960 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.782097 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.782267 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.782400 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.782589 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.782714 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.782894 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.783030 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.783200 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.784097 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.784097 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.784364 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.784508 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.784633 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.784762 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.784885 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.785008 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.785130 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.785267 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.785457 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.785577 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.785681 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.785818 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.785949 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.785949 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.786200 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.786323 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.786452 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.786581 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.786704 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.786838 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.786961 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.787083 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.787205 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.787340 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.787475 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.787607 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.787731 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.787859 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.787991 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.788114 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.788236 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.788369 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.788534 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.788675 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.788854 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.788987 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.789162 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.789301 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.789502 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.789627 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.789778 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.789905 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.790079 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.790219 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.790382 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.790511 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.790683 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.790811 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.790985 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.791121 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.791283 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.791420 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.791585 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.791712 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.791882 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.792018 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.792195 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.792322 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.792512 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.792646 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.792820 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.792945 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.793130 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.793256 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.793544 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.793682 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.793825 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.793949 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.794072 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.794200 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.794357 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.794497 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.794665 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.794792 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.794973 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.795099 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.795278 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.795414 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.795600 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.795719 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.795926 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.796051 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.796242 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.796377 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.796552 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.796690 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.796861 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.796988 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.797176 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.797308 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:02.797510 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.797651 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.797825 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.797950 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.798151 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.798277 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.798441 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.798566 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.798765 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.798895 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.799078 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.799206 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.799390 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.799516 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.799703 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.799830 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.800010 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.800137 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.800324 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.800459 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.800650 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.800787 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.801012 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.801144 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.801327 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.801476 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.801691 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.801818 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.802013 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.802140 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.802333 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.802465 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.802655 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.802781 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.802974 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.803108 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.803282 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.803407 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.803693 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.803842 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.803966 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.804088 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.804217 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.804346 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.804514 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.804655 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.804824 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.804961 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.805141 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.805275 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.805473 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.805620 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.805796 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.805923 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.806104 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.806239 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.806410 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.806547 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.806719 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.806994 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.807132 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.807259 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.807394 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.807519 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.807642 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.807765 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.807942 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.808070 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.808263 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.808399 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.808573 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.808701 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.808884 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.809020 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.809203 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.809333 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.809542 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.809666 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.809849 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.809987 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.810153 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.810286 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.810456 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.810582 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.810757 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.810891 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.811060 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.811195 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.811367 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.811501 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.811668 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.811807 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.811983 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.812110 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.812307 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.812444 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.812612 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.812756 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.812925 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.813050 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.813235 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.813361 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.813569 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.813834 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.813981 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.814105 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.814236 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.814360 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.814483 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.814615 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.814746 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.814869 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.815049 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.815178 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.815356 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.815486 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.815677 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.815813 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.815988 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.816113 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.816291 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.816418 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.817291 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.817519 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.817713 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.817907 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.818110 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.818297 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.818482 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.818677 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.818881 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.819060 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.819198 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.819323 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.819464 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.819603 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.819743 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.819945 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.820138 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.820334 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.820510 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.820697 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.820829 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.820964 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.821123 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.821261 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.821453 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.821579 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.821702 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.821910 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.822039 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.822162 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.822292 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.822424 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.822547 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.822678 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.822792 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.822913 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.823037 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.823159 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.823295 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.823430 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.823553 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.823682 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.823812 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.824025 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.824163 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.824297 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.824422 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.824545 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.824667 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.824790 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.824925 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.825055 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.825185 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.825308 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.825514 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.825645 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.825825 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.825962 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.826136 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.826262 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.826440 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.826580 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.826743 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.826871 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.827047 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.827175 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.827386 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.827536 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.827661 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.827784 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.827962 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.828090 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.828272 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.828408 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.828584 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.828712 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.828894 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.829029 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.829228 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.829369 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.829552 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.829674 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.829863 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.829988 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.830171 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.830299 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.830475 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.830600 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.830781 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.830906 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.831099 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.831234 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.831409 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.831536 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.831728 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.831861 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.832038 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.832166 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.833202 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.833643 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.834087 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.834414 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.835896 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.836050 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.836050 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.836277 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.836453 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.836596 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.837840 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.837983 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.838151 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.838316 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.838448 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.838585 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.838711 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.838842 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.838965 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.839088 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.839243 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.839496 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.839663 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.839801 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.839908 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.840046 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.840227 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.840360 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.840468 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.840580 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.840685 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.840790 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.840893 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.841015 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.841159 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.841159 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.841522 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.841689 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.841887 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.842052 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.842218 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.842385 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.842569 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.842686 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.842802 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.842915 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.843049 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.843165 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.843303 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.843471 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.843659 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.843827 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.843980 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.844178 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.844458 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.844582 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.844760 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.844926 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.845092 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.845259 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.845508 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.845722 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.845880 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.846015 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.846153 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.846301 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.846415 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.846415 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.846767 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.846956 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.847130 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.847320 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.847511 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.847666 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.848011 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.848231 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.848432 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.848620 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.848807 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.849009 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.849201 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.849344 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.849504 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.849651 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.849799 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.849938 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.850124 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.850319 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.850502 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.850502 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.850865 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.851048 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.851194 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.851380 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.851563 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.851749 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.851937 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.852140 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.852331 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.852505 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.852631 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.852754 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.852904 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.853033 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.853195 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.853438 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.853629 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.853809 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.854009 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.854179 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.854363 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.854586 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.854714 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.854923 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.855050 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.855181 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.855295 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.855424 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.855549 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.855686 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.855810 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.855933 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.856064 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.856187 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.856309 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.856440 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.856572 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.856696 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.856826 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.856949 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.857075 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.857208 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.857332 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.857332 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.857608 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.857732 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.857863 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.858080 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.858215 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.858339 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.858461 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.858584 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.858715 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.858847 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.858970 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.859099 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.859223 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.859344 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.859475 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.859606 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.859730 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.859885 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.860009 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.860131 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.860263 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.860387 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.860509 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.860630 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.860754 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.860885 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.861018 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.861018 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.861256 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.861426 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.861552 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.861688 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.861814 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.861949 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.862072 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.862195 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.862323 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.862456 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.862579 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.862579 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.862830 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.862955 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.863078 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.863199 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.863330 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.863474 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.863600 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.863722 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.863846 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.863968 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.864098 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.864230 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.864362 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.864485 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.864627 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.864834 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.864962 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.865094 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.865218 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.865340 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.865473 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.865597 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.865719 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.865854 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.865980 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.866102 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.866102 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.866332 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.866468 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.866582 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.866711 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.866834 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.866956 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.867078 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.867209 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.867332 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.867455 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.867576 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.867698 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.867820 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.867956 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.868100 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.868293 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.868428 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.868552 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.868675 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.868806 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.868929 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.869052 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.869175 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.869297 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.869485 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.869621 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.869752 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.869875 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.869997 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.869997 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.870237 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.870361 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.870490 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.870613 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.870734 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.870857 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.870990 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.871114 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.871237 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.871403 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.871531 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.871705 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.871834 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.872014 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.872148 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.872321 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.872448 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.872624 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.872753 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.872932 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.873060 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.873240 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.873403 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.873575 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.873704 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.873883 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.874019 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.874185 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.874313 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.874493 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.874622 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.874878 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.875025 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.875150 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.875360 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.875495 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.875620 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.875751 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.875875 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.876004 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.876136 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.876283 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.876412 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.876592 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.876713 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.876899 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.877036 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.877209 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.877337 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.877535 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.877664 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.877850 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.877989 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.878153 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.878294 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.878487 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.878626 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.878759 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.878872 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.879044 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.879699 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.879911 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.880037 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.880221 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.880347 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.880541 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.880669 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.880849 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.880990 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.881155 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.881284 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.881481 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.881612 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.881793 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.881920 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.882097 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.882227 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.882401 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.882529 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.882711 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.882851 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.883028 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.883162 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.883341 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.883467 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.883639 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.883775 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.883949 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.884076 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.884252 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.884379 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.884555 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.884691 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.884858 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.885074 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.885210 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.885343 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.885519 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.885657 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.885783 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.885907 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.886054 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.886189 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.886356 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.886485 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.886659 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.886773 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.886981 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.887105 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.887288 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.887419 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.887589 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.887702 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.888148 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.888262 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.888452 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.888662 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.888789 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.888911 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.889052 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.889188 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.889400 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.889530 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.889728 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.889842 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.890039 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.890177 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.890352 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.890480 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.890660 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.890787 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.890970 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.891109 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.891282 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.891471 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.891596 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.891720 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.891885 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.892021 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.892193 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.892321 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.892506 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.892634 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.892809 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.892947 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.893112 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.893242 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.893455 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.893588 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.893767 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.893915 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.894077 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.894206 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.894396 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.894529 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.894739 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.895379 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.895582 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.895719 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.895994 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.896128 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.896246 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.896352 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.896469 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.896576 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.896778 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.896869 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.897089 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.897177 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.897415 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.897518 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.897729 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.897823 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.898039 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.898128 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.898349 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.898438 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.898710 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.898818 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.898965 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.899058 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.899268 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.899396 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.899578 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.899719 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.899886 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.900014 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.900196 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.900324 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.900509 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.900645 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.900813 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.900939 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.901116 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.901243 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.901447 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.901601 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.901754 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.901888 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.902065 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.902191 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.902368 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.902505 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.902693 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.902827 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.903006 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.903134 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.903318 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.903447 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.903634 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.903764 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.903946 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.904081 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.904261 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.904390 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.904571 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.904705 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.904879 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.905005 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.905205 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.905332 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.905629 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.905769 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.905921 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.906062 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.906229 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.906358 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.906538 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.906673 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.906843 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.906979 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.907183 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.907310 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.907432 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.907542 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.907745 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.907882 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.908048 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.908176 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.908349 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.908477 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.908651 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.908803 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.908996 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.909124 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.909259 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.909421 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.909605 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.909735 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.910003 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.910141 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.910338 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.910473 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.910693 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.910870 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.910996 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.911178 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.911451 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.911589 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.911769 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.911898 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.912098 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.912227 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.914887 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.915062 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.915210 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.915338 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.915470 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.915601 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.915847 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.915985 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.916111 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.916235 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.916368 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.916493 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.916615 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.916738 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.916861 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.916992 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.917148 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.917277 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.917434 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.917561 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.917673 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.917884 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.918018 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.918141 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.918264 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.918389 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.918511 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.918643 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.918775 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.918901 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.919040 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.919240 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.919361 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.919499 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.919625 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.919755 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.919880 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.920003 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.920136 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.920261 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.920384 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.920507 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.920630 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.920630 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.920871 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.920996 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.921122 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.921245 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.921367 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.921567 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.921710 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.921848 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.921972 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.922096 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.922218 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.922341 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.922473 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.922606 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.922731 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.922854 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.922976 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.923112 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.923236 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.923358 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.923481 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.923604 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.923727 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.923863 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.923988 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.924110 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.924240 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.924364 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.924487 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.924619 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.924752 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.924880 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.925004 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.925128 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.925251 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.925413 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.925553 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.925686 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.925834 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.926621 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.926791 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.926920 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.927045 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.927176 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.927301 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.927432 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.927570 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.927702 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.927817 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.927939 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.928062 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.928191 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.928329 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.928453 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.928589 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.928713 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.928842 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.928967 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.929098 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.929239 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.929490 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.929632 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.929758 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.929890 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.930015 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.930137 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.930260 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.930382 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.930512 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.930644 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.930775 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.930909 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.931033 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.931155 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.931286 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.931423 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.931606 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.931735 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.931923 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.932051 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.932212 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.932347 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.932531 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.932656 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.932831 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.932957 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.933145 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.933272 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.933474 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.933602 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.933779 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.933908 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.934085 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.934213 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.934386 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.934522 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.934727 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.934855 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.935031 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.935161 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.935358 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.935485 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.935667 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.935799 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.935990 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.936128 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.936306 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.936433 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.936661 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.936802 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.936928 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.937051 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.937216 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.937346 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.937554 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.937696 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.937868 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.937997 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.938182 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.938312 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.938492 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.938630 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.938805 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.938935 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.939117 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.939246 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.939476 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.939624 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.939751 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.939988 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.940119 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.940316 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.940454 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.940636 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.940775 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.940950 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.941078 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.941263 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.941427 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.941713 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.941849 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.942123 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.942251 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.942452 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.942590 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.942815 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.943017 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.943146 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.943355 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.943485 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.943680 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.943809 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.944001 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.944129 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.944323 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.944465 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.944645 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.944773 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.944964 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.945092 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.945284 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.945530 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.945662 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.945786 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.945932 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.946062 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.946253 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.946391 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.946589 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.946811 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.946947 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.947078 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.947199 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.947331 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.947506 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.947635 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.947824 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.947953 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.948137 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.948267 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.948451 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.948581 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.948767 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.948904 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.949164 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.949305 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.949489 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.949716 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.949848 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.950875 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.951009 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.951183 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.951309 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.951432 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.951565 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.951697 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.951822 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.951953 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.952068 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.952189 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.952321 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.952446 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.952573 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.952695 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.952818 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.952940 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.952940 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.953195 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.953319 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.953465 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.953591 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.953732 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.953866 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.953989 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.954120 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.954244 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.954373 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.954510 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.954676 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.954811 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.954935 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.955059 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.955183 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.955319 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.955443 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.955566 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.955730 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.955875 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.956023 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.956163 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.956328 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.956496 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.956648 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.956878 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.957021 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.957145 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.957822 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.957989 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.958103 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.958312 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.958480 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.958628 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.958933 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.959064 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.959249 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.959376 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.959566 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.959710 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.959942 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.960071 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.960196 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.960320 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.960494 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.960633 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.960798 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.960933 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.961125 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.961263 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.961453 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.961585 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.961763 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.962000 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.962124 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.962357 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.962488 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.962668 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.962794 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.962974 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.963134 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.963274 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.963400 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.963576 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.963705 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.963882 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.964019 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.964192 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.964322 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.964493 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.964622 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.964817 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.964955 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.965123 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.965252 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.965459 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.965591 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.965756 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.965900 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.966067 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.966204 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.966370 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.966499 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.966675 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.966813 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.967023 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.967159 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.967285 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.967408 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.967573 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.967716 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.967876 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.968013 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.968183 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.968304 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.968487 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.968604 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.969429 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.969582 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.969582 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.969718 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.969796 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.969866 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.969866 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.970025 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.970101 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.970170 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.970328 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.970417 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.970633 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.970713 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.970949 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.971026 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.973169 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.973541 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.973704 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.973841 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.973947 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.974022 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.974099 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.974174 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.974242 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.974309 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.974309 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.974444 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.974444 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.974444 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.974635 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.974702 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.974702 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.974838 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.974907 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.974974 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.975040 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.975105 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.975255 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.975408 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.975487 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.975723 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.975812 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.976039 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.976118 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.976354 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.976626 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.976770 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.976971 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.977329 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.977329 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.980442 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.980607 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.980794 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.980937 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.981112 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.981776 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.981910 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.982036 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.982162 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.982287 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.983237 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.983431 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.983565 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.983699 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.984276 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.984415 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.984543 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.984669 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.984794 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.984918 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.985100 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.987706 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.987866 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.988002 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.988133 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.988344 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.989090 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.989812 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.989947 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.990084 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.990220 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.990347 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.990483 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.990600 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.990707 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.990831 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.990956 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.991084 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.991218 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.991345 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.991479 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.991605 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.991730 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.991949 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.992090 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.992217 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.992341 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.992475 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.992603 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.992737 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.992864 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.992989 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.993116 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.993285 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.993426 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.993565 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.993692 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.993816 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.993949 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.994074 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.994205 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.994339 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.994465 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.994597 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.994721 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.994846 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.994980 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.995089 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.995199 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.995331 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.995464 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.995589 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.995731 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.995856 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.995982 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.996106 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.996241 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.996367 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.996508 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.996635 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.996760 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.996883 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.997008 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.997141 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.997141 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.997377 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.997519 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.997661 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.997788 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.997922 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.998049 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.998182 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.998307 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.998430 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.998554 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.998735 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.998877 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.999003 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.999230 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.999361 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.999485 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.999620 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.999745 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.999870 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:02.999994 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.000118 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.000256 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.000390 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.000516 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.000649 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.000764 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.000870 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.001006 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.001132 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.001266 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.001410 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.001537 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.001674 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.001811 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.001952 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.002159 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.002290 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.002415 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.002555 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.002682 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.002682 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.002918 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.003041 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.003165 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.003350 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.003480 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.003606 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.003731 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.003731 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.003977 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.004132 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.004816 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.004943 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.005081 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.005197 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.005320 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.005489 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.005655 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.005839 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.005968 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.006093 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.006227 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.006354 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.006492 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.006626 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.006764 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.006898 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.007033 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.007169 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.007295 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.007420 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.007546 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.007671 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.007806 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.007939 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.008065 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.008189 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.008322 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.008447 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.008582 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.008582 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.008819 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.008943 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.009068 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.009289 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.009526 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.009526 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.009783 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.009911 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.010044 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.010044 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.010299 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.010433 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.010559 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.010686 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.010810 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.010932 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.011061 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.011187 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.011312 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.011437 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.011570 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.011698 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.011823 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.011955 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.012081 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.012295 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.012439 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.012567 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.012700 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.013086 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.013220 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.013358 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.013567 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.013695 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.013822 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.013954 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.014080 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.014214 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.014340 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.014506 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.014637 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.014761 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.015025 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.015165 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.015291 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.015417 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.015542 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.015667 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.015792 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.015927 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.016061 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.016187 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.016313 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.016437 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.016561 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.016695 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.016821 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.016955 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.017081 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.017206 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.017339 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.017506 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.017634 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.017759 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 09:39:03.017884 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.017884 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.017884 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.017884 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.017884 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.017884 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.017884 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.017884 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.018803 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.018803 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:03.018803 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 09:39:03.171441 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO dbcounter [None req-cdebf97f-54eb-4ec0-b423-d141fb5ac705 None None] Registered counter for database nova_api Aug 31 09:39:03.174322 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO dbcounter [None req-55051f88-2b46-408b-a227-3586612896c7 None None] Registered counter for database nova_api Aug 31 09:39:03.195718 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG oslo_db.sqlalchemy.engines [None req-55051f88-2b46-408b-a227-3586612896c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:39:03.195971 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_db.sqlalchemy.engines [None req-cdebf97f-54eb-4ec0-b423-d141fb5ac705 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:39:03.202981 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG dbcounter [-] [112134] Writer thread running {{(pid=112134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:39:03.203629 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG dbcounter [-] [112133] Writer thread running {{(pid=112133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:39:03.264773 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.context [None req-55051f88-2b46-408b-a227-3586612896c7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),28536b87-4849-4a8b-a399-9479669b101c(cell1) {{(pid=112134) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 09:39:03.268681 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG oslo_concurrency.lockutils [None req-55051f88-2b46-408b-a227-3586612896c7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:39:03.269171 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG oslo_concurrency.lockutils [None req-55051f88-2b46-408b-a227-3586612896c7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:39:03.270671 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.context [None req-cdebf97f-54eb-4ec0-b423-d141fb5ac705 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),28536b87-4849-4a8b-a399-9479669b101c(cell1) {{(pid=112133) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 09:39:03.270843 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG oslo_concurrency.lockutils [None req-55051f88-2b46-408b-a227-3586612896c7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:39:03.271600 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG oslo_concurrency.lockutils [None req-55051f88-2b46-408b-a227-3586612896c7 None None] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:39:03.272050 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG oslo_concurrency.lockutils [None req-55051f88-2b46-408b-a227-3586612896c7 None None] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:39:03.274105 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG oslo_concurrency.lockutils [None req-55051f88-2b46-408b-a227-3586612896c7 None None] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:39:03.276171 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO dbcounter [None req-55051f88-2b46-408b-a227-3586612896c7 None None] Registered counter for database nova_cell0 Aug 31 09:39:03.277604 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-cdebf97f-54eb-4ec0-b423-d141fb5ac705 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:39:03.278193 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-cdebf97f-54eb-4ec0-b423-d141fb5ac705 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:39:03.280164 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-cdebf97f-54eb-4ec0-b423-d141fb5ac705 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:39:03.280635 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO dbcounter [None req-55051f88-2b46-408b-a227-3586612896c7 None None] Registered counter for database nova_cell1 Aug 31 09:39:03.280933 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-cdebf97f-54eb-4ec0-b423-d141fb5ac705 None None] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:39:03.281444 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-cdebf97f-54eb-4ec0-b423-d141fb5ac705 None None] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:39:03.283479 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-cdebf97f-54eb-4ec0-b423-d141fb5ac705 None None] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:39:03.288493 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO dbcounter [None req-cdebf97f-54eb-4ec0-b423-d141fb5ac705 None None] Registered counter for database nova_cell0 Aug 31 09:39:03.290633 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO dbcounter [None req-cdebf97f-54eb-4ec0-b423-d141fb5ac705 None None] Registered counter for database nova_cell1 Aug 31 09:39:03.291044 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG oslo_db.sqlalchemy.engines [None req-55051f88-2b46-408b-a227-3586612896c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:39:03.292314 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG oslo_db.sqlalchemy.engines [None req-55051f88-2b46-408b-a227-3586612896c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:39:03.298752 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_db.sqlalchemy.engines [None req-cdebf97f-54eb-4ec0-b423-d141fb5ac705 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:39:03.300060 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG dbcounter [-] [112134] Writer thread running {{(pid=112134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:39:03.303572 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG dbcounter [-] [112134] Writer thread running {{(pid=112134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:39:03.304606 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_db.sqlalchemy.engines [None req-cdebf97f-54eb-4ec0-b423-d141fb5ac705 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:39:03.305265 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG dbcounter [-] [112133] Writer thread running {{(pid=112133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:39:03.447836 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG dbcounter [-] [112133] Writer thread running {{(pid=112133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:39:03.452278 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO dbcounter [None req-55051f88-2b46-408b-a227-3586612896c7 None None] Registered counter for database nova_cell0 Aug 31 09:39:03.457186 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO dbcounter [None req-cdebf97f-54eb-4ec0-b423-d141fb5ac705 None None] Registered counter for database nova_cell0 Aug 31 09:39:03.462832 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG oslo_db.sqlalchemy.engines [None req-55051f88-2b46-408b-a227-3586612896c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:39:03.467510 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_db.sqlalchemy.engines [None req-cdebf97f-54eb-4ec0-b423-d141fb5ac705 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:39:03.468597 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG dbcounter [-] [112134] Writer thread running {{(pid=112134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:39:03.475326 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG dbcounter [-] [112133] Writer thread running {{(pid=112133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:39:03.838493 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: WARNING keystonemiddleware.auth_token [None req-cdebf97f-54eb-4ec0-b423-d141fb5ac705 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 09:39:03.844658 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: WARNING keystonemiddleware.auth_token [None req-55051f88-2b46-408b-a227-3586612896c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 09:39:03.846040 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: WARNING keystonemiddleware.auth_token [None req-cdebf97f-54eb-4ec0-b423-d141fb5ac705 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 09:39:03.852883 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: WARNING keystonemiddleware.auth_token [None req-55051f88-2b46-408b-a227-3586612896c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 09:39:04.201525 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: WARNING keystonemiddleware.auth_token [None req-cdebf97f-54eb-4ec0-b423-d141fb5ac705 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 09:39:04.208287 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: WARNING keystonemiddleware.auth_token [None req-cdebf97f-54eb-4ec0-b423-d141fb5ac705 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 09:39:04.213745 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561c268ce9c0 pid: 112133 (default app) Aug 31 09:39:04.215900 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-cdebf97f-54eb-4ec0-b423-d141fb5ac705 None None] Calling method '>' {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:39:04.217114 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-cdebf97f-54eb-4ec0-b423-d141fb5ac705 None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001824 Aug 31 09:39:04.217554 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Wed Aug 31 09:39:04 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:39:04.223526 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: WARNING keystonemiddleware.auth_token [None req-55051f88-2b46-408b-a227-3586612896c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 09:39:04.229757 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: WARNING keystonemiddleware.auth_token [None req-55051f88-2b46-408b-a227-3586612896c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 09:39:04.235122 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561c268ce9c0 pid: 112134 (default app) Aug 31 09:40:27.449056 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-cdebf97f-54eb-4ec0-b423-d141fb5ac705 None None] Calling method '>' {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:27.450740 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-cdebf97f-54eb-4ec0-b423-d141fb5ac705 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002179 Aug 31 09:40:27.451139 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 2/2] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 31 09:40:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:40:27.472570 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG dbcounter [-] [112134] Writing DB stats nova_api:SELECT=3 {{(pid=112134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:27.473678 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG dbcounter [-] [112134] Writing DB stats nova_cell0:SELECT=3 {{(pid=112134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:27.474644 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG dbcounter [-] [112134] Writing DB stats nova_cell1:SELECT=3 {{(pid=112134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:27.475447 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG dbcounter [-] [112134] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:28.453334 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-508ec523-083d-4f49-b038-f61ac3b9c470 admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:28.489480 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-508ec523-083d-4f49-b038-f61ac3b9c470 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.027828 Aug 31 09:40:28.497589 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 1/3] 10.222.0.13 () {60 vars in 1292 bytes} [Wed Aug 31 09:40:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:40:31.042308 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-cdebf97f-54eb-4ec0-b423-d141fb5ac705 None None] Calling method '>' {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:31.043389 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-cdebf97f-54eb-4ec0-b423-d141fb5ac705 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 31 09:40:31.044058 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 3/4] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 31 09:40:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:40:31.640848 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-e9b92cba-4add-4ffb-b1da-ce169ebdaeca admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "ram": 256, "swap": 0, "id": "c1"}} {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:40:31.702011 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-e9b92cba-4add-4ffb-b1da-ce169ebdaeca admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.649871 Aug 31 09:40:31.703005 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 2/5] 10.222.0.13 () {64 vars in 1283 bytes} [Wed Aug 31 09:40:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:40:31.942172 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-665c486a-af22-414d-9ec1-975e808bf7c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:40:31.948118 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG dbcounter [-] [112133] Writing DB stats nova_api:SELECT=3 {{(pid=112133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:31.949030 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG dbcounter [-] [112133] Writing DB stats nova_cell0:SELECT=3 {{(pid=112133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:31.950368 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG dbcounter [-] [112133] Writing DB stats nova_cell1:SELECT=3 {{(pid=112133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:31.951159 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG dbcounter [-] [112133] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:32.027073 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-665c486a-af22-414d-9ec1-975e808bf7c1 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.313785 Aug 31 09:40:32.028135 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 4/6] 10.222.0.13 () {64 vars in 1336 bytes} [Wed Aug 31 09:40:31 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:40:34.471828 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-e9b92cba-4add-4ffb-b1da-ce169ebdaeca admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:34.472848 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-e9b92cba-4add-4ffb-b1da-ce169ebdaeca admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 31 09:40:34.473254 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 3/7] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 31 09:40:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:40:35.218422 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-587ea80b-20d9-4f70-9049-9816be2e254d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "disk": 5, "swap": 0, "ram": 512, "id": "d1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:40:35.262851 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-587ea80b-20d9-4f70-9049-9816be2e254d admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.782895 Aug 31 09:40:35.263790 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 5/8] 10.222.0.13 () {64 vars in 1283 bytes} [Wed Aug 31 09:40:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:40:35.276818 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-3350be9b-33d8-4eca-a8cd-ba5e07700018 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:40:35.316375 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-3350be9b-33d8-4eca-a8cd-ba5e07700018 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043235 Aug 31 09:40:35.317930 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 4/9] 10.222.0.13 () {64 vars in 1336 bytes} [Wed Aug 31 09:40:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:40:37.746610 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-587ea80b-20d9-4f70-9049-9816be2e254d admin admin] Calling method '>' {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:37.747627 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-587ea80b-20d9-4f70-9049-9816be2e254d admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 31 09:40:37.748032 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 6/10] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 31 09:40:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:40:38.221224 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-e1e01805-8e35-4f65-ab86-268b8f4e9c22 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds1G", "vcpus": 1, "ram": 1024, "os-flavor-access:is_public": true}} {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:40:38.240306 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-e1e01805-8e35-4f65-ab86-268b8f4e9c22 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.485160 Aug 31 09:40:38.240879 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 5/11] 10.222.0.13 () {64 vars in 1283 bytes} [Wed Aug 31 09:40:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:40:38.253408 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-f7cc2eca-cd8b-45ee-ae41-57fc51c36b34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:40:38.279161 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-f7cc2eca-cd8b-45ee-ae41-57fc51c36b34 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029992 Aug 31 09:40:38.279742 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 7/12] 10.222.0.13 () {64 vars in 1336 bytes} [Wed Aug 31 09:40:38 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:40:40.726841 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-e1e01805-8e35-4f65-ab86-268b8f4e9c22 admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:40.727787 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-e1e01805-8e35-4f65-ab86-268b8f4e9c22 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 31 09:40:40.728193 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 6/13] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 31 09:40:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:40:41.217459 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-22cfeef1-2144-4416-b254-71da3d4dc861 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 2, "rxtx_factor": 1.0, "name": "ds2G", "id": "d3", "ram": 2048}} {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:40:41.241073 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-22cfeef1-2144-4416-b254-71da3d4dc861 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.505093 Aug 31 09:40:41.242259 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 8/14] 10.222.0.13 () {64 vars in 1283 bytes} [Wed Aug 31 09:40:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:40:41.255037 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-bcb112e3-5217-43a8-8b33-96a4152fc124 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:40:41.284308 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-bcb112e3-5217-43a8-8b33-96a4152fc124 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033834 Aug 31 09:40:41.285585 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 7/15] 10.222.0.13 () {64 vars in 1336 bytes} [Wed Aug 31 09:40:41 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:40:43.853903 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-22cfeef1-2144-4416-b254-71da3d4dc861 admin admin] Calling method '>' {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:43.855127 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-22cfeef1-2144-4416-b254-71da3d4dc861 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001663 Aug 31 09:40:43.855523 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 9/16] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 31 09:40:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:40:44.335754 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-783ec532-e7d0-4e82-afa0-b953a49a5ed5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "ds4G", "ram": 4096, "id": "d4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:40:44.356761 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-783ec532-e7d0-4e82-afa0-b953a49a5ed5 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.493656 Aug 31 09:40:44.357712 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 8/17] 10.222.0.13 () {64 vars in 1283 bytes} [Wed Aug 31 09:40:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:40:44.370654 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-00ea2c82-ddc7-4f6a-a488-9ae973edb02e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:40:44.414196 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-00ea2c82-ddc7-4f6a-a488-9ae973edb02e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046650 Aug 31 09:40:44.416541 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 10/18] 10.222.0.13 () {64 vars in 1336 bytes} [Wed Aug 31 09:40:44 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:40:46.940785 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-783ec532-e7d0-4e82-afa0-b953a49a5ed5 admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:46.942466 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-783ec532-e7d0-4e82-afa0-b953a49a5ed5 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002085 Aug 31 09:40:46.943017 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 9/19] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 31 09:40:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:40:47.455018 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-79678be1-a384-4666-bd49-3d198ce3a21d admin admin] Calling method '>' {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:47.480636 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-79678be1-a384-4666-bd49-3d198ce3a21d admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.529474 Aug 31 09:40:47.481337 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 11/20] 10.222.0.13 () {60 vars in 1292 bytes} [Wed Aug 31 09:40:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:40:50.073371 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-783ec532-e7d0-4e82-afa0-b953a49a5ed5 admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:50.074833 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-783ec532-e7d0-4e82-afa0-b953a49a5ed5 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002020 Aug 31 09:40:50.075403 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 10/21] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 31 09:40:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:40:50.590007 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-6e156ea7-79f2-482d-a8c7-606d1bf7fa1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "name": "m1.tiny", "id": "1", "ram": 512}} {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:40:50.611306 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-6e156ea7-79f2-482d-a8c7-606d1bf7fa1b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.525393 Aug 31 09:40:50.611895 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 12/22] 10.222.0.13 () {64 vars in 1283 bytes} [Wed Aug 31 09:40:50 2022] POST /compute/v2.1/flavors => generated 402 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:40:50.628359 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-027d1d95-5320-46a6-958a-523e05a64b08 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:40:50.658094 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-027d1d95-5320-46a6-958a-523e05a64b08 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034587 Aug 31 09:40:50.658727 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 11/23] 10.222.0.13 () {64 vars in 1333 bytes} [Wed Aug 31 09:40:50 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:40:53.354848 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-6e156ea7-79f2-482d-a8c7-606d1bf7fa1b admin admin] Calling method '>' {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:53.356362 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-6e156ea7-79f2-482d-a8c7-606d1bf7fa1b admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001973 Aug 31 09:40:53.356939 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 13/24] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 31 09:40:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:40:53.864210 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-b09de92c-455b-4728-bb31-a11f63ed6ddd admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "disk": 20, "ram": 2048}} {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:40:53.885008 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-b09de92c-455b-4728-bb31-a11f63ed6ddd admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.520272 Aug 31 09:40:53.885892 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 12/25] 10.222.0.13 () {64 vars in 1283 bytes} [Wed Aug 31 09:40:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:40:53.899227 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-3dd1563d-7dec-42f0-88cb-f01eb853d3fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:40:53.926115 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-3dd1563d-7dec-42f0-88cb-f01eb853d3fb admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031442 Aug 31 09:40:53.926718 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 14/26] 10.222.0.13 () {64 vars in 1333 bytes} [Wed Aug 31 09:40:53 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:40:56.822626 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-b09de92c-455b-4728-bb31-a11f63ed6ddd admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:56.823633 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-b09de92c-455b-4728-bb31-a11f63ed6ddd admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 31 09:40:56.824041 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 13/27] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 31 09:40:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:40:57.260156 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-f3fd47cd-bfaf-413a-8888-3ad89f97e222 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "os-flavor-access:is_public": true, "swap": 0, "disk": 40, "name": "m1.medium", "rxtx_factor": 1.0, "vcpus": 2, "ram": 4096}} {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:40:57.286132 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-f3fd47cd-bfaf-413a-8888-3ad89f97e222 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.449858 Aug 31 09:40:57.286960 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 15/28] 10.222.0.13 () {64 vars in 1283 bytes} [Wed Aug 31 09:40:56 2022] POST /compute/v2.1/flavors => generated 406 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:40:57.301154 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-7fa7ac76-4ac7-4768-97d1-13a240c91799 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:40:57.327418 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-7fa7ac76-4ac7-4768-97d1-13a240c91799 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031940 Aug 31 09:40:57.328245 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 14/29] 10.222.0.13 () {64 vars in 1333 bytes} [Wed Aug 31 09:40:57 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:40:59.918036 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-f3fd47cd-bfaf-413a-8888-3ad89f97e222 admin admin] Calling method '>' {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:40:59.919062 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-f3fd47cd-bfaf-413a-8888-3ad89f97e222 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Aug 31 09:40:59.919502 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 16/30] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 31 09:40:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:41:00.439815 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-787977ee-4dfb-4efa-ba5e-8b9ae8cbfc1e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "name": "m1.large", "swap": 0, "ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:00.447522 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG dbcounter [-] [112134] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:41:00.469657 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-787977ee-4dfb-4efa-ba5e-8b9ae8cbfc1e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.541350 Aug 31 09:41:00.470587 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 15/31] 10.222.0.13 () {64 vars in 1283 bytes} [Wed Aug 31 09:40:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:41:00.483689 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-88e31400-0bf1-4aea-87ae-d0e8d6989452 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:00.515000 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-88e31400-0bf1-4aea-87ae-d0e8d6989452 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035018 Aug 31 09:41:00.516236 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 17/32] 10.222.0.13 () {64 vars in 1333 bytes} [Wed Aug 31 09:41:00 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:41:03.517619 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-787977ee-4dfb-4efa-ba5e-8b9ae8cbfc1e admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:03.519687 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-787977ee-4dfb-4efa-ba5e-8b9ae8cbfc1e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002920 Aug 31 09:41:03.520228 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 16/33] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 31 09:41:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:41:04.067994 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-acca9cb4-a5e8-41fe-914a-7d6549c48489 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "vcpus": 8, "disk": 160, "ram": 16384}} {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:04.074067 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG dbcounter [-] [112133] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:41:04.102725 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-acca9cb4-a5e8-41fe-914a-7d6549c48489 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.574632 Aug 31 09:41:04.104072 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 18/34] 10.222.0.13 () {64 vars in 1283 bytes} [Wed Aug 31 09:41:03 2022] POST /compute/v2.1/flavors => generated 408 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:41:04.119073 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-ec336d62-9a00-4d7d-ad77-3d302c661779 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:04.152979 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-ec336d62-9a00-4d7d-ad77-3d302c661779 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039917 Aug 31 09:41:04.153881 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 17/35] 10.222.0.13 () {64 vars in 1333 bytes} [Wed Aug 31 09:41:04 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:41:28.466342 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-acca9cb4-a5e8-41fe-914a-7d6549c48489 admin admin] Calling method '>' {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:28.467351 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-acca9cb4-a5e8-41fe-914a-7d6549c48489 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 31 09:41:28.467757 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 19/36] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 31 09:41:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:41:28.480719 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG dbcounter [-] [112134] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:41:28.924256 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-38bf7780-2f0d-4162-9eea-80656ec7fac3 admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:28.945219 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-38bf7780-2f0d-4162-9eea-80656ec7fac3 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.469049 Aug 31 09:41:28.945803 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1292 bytes} [Wed Aug 31 09:41:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:41:30.135974 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-acca9cb4-a5e8-41fe-914a-7d6549c48489 admin admin] Calling method '>' {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:30.136908 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-acca9cb4-a5e8-41fe-914a-7d6549c48489 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001756 Aug 31 09:41:30.137341 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 20/38] 10.222.0.13 () {56 vars in 1074 bytes} [Wed Aug 31 09:41:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:41:30.841239 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-3bc77b17-dc18-44dd-81ac-252698a2dc58 admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:30.848199 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.wsgi [None req-3bc77b17-dc18-44dd-81ac-252698a2dc58 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 09:41:30.851523 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-3bc77b17-dc18-44dd-81ac-252698a2dc58 admin admin] Request method failure captured: Aug 31 09:41:30.851523 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 09:41:30.851523 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: Accept: application/json Aug 31 09:41:30.851523 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: Accept-Encoding: gzip, deflate Aug 31 09:41:30.851523 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: Connection: keep-alive Aug 31 09:41:30.851523 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: Content-Length: 0 Aug 31 09:41:30.851523 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: Host: 10.222.0.13 Aug 31 09:41:30.851523 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: Openstack-Api-Version: compute 2.90 Aug 31 09:41:30.851523 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: Openstack-System-Scope: None Aug 31 09:41:30.851523 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: User-Agent: python-novaclient Aug 31 09:41:30.851523 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Auth-Token: gAAAAABjDyzK4y-sPQP4XUoDDtNlhMp6EXhoT3G5Txh2LpvM4cUxvmkLY7voQ0osa2khGnQplGXF6_I8ylx6XvvnxtqbFcCU5WK2NHlueima3WUCd_aKJEO_PI532yc1db1Hnay6HiNtYj2vprW78TWo3wh9MKuQFRbRMIQbrzso-w1t0r2DPsQ Aug 31 09:41:30.851523 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Domain-Id: None Aug 31 09:41:30.851523 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Domain-Name: None Aug 31 09:41:30.851523 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Identity-Status: Confirmed Aug 31 09:41:30.851523 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Is-Admin-Project: True Aug 31 09:41:30.851523 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 09:41:30.851523 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Project-Domain-Id: default Aug 31 09:41:30.851523 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Project-Domain-Name: Default Aug 31 09:41:30.851523 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Project-Id: 3f187a2ac46b4c229b4eeead01522f05 Aug 31 09:41:30.851523 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Project-Name: admin Aug 31 09:41:30.851523 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Role: admin,member,reader Aug 31 09:41:30.851523 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Roles: admin,member,reader Aug 31 09:41:30.853122 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3f187a2ac46b4c229b4eeead01522f05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3f187a2ac46b4c229b4eeead01522f05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3f187a2ac46b4c229b4eeead01522f05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3f187a2ac46b4c229b4eeead01522f05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:41:30.853122 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Tenant: admin Aug 31 09:41:30.853122 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Tenant-Id: 3f187a2ac46b4c229b4eeead01522f05 Aug 31 09:41:30.853122 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Tenant-Name: admin Aug 31 09:41:30.853122 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-User: admin Aug 31 09:41:30.853122 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-User-Domain-Id: default Aug 31 09:41:30.853122 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-User-Domain-Name: Default Aug 31 09:41:30.853122 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-User-Id: fd836cf590a145df9acf19cf3ae2ac56 Aug 31 09:41:30.853122 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-User-Name: admin Aug 31 09:41:30.853122 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: method: > Aug 31 09:41:30.853122 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: exception: Flavor 42 could not be found. Aug 31 09:41:30.853122 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: action_args: {'id': '42'} Aug 31 09:41:30.853122 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:41:30.853122 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:41:30.854141 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 09:41:30.854141 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 09:41:30.854141 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 09:41:30.854141 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 09:41:30.854141 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 09:41:30.854141 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 09:41:30.854141 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 09:41:30.854141 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 09:41:30.854141 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 09:41:30.854141 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:41:30.854141 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 09:41:30.854141 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 09:41:30.854141 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 09:41:30.854141 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi Aug 31 09:41:30.854141 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:41:30.854141 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi Aug 31 09:41:30.854141 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:41:30.854141 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:41:30.854141 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:41:30.855475 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:41:30.855475 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:41:30.855475 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:41:30.855475 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:41:30.855475 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 09:41:30.855475 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:41:30.855475 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 09:41:30.855475 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi Aug 31 09:41:30.855475 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:41:30.855475 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi Aug 31 09:41:30.855475 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:41:30.855475 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:41:30.855475 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:41:30.855475 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:41:30.855475 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:41:30.855475 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 09:41:30.855475 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi Aug 31 09:41:30.855475 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-3bc77b17-dc18-44dd-81ac-252698a2dc58 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:41:30.856626 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-3bc77b17-dc18-44dd-81ac-252698a2dc58 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.458849 Aug 31 09:41:30.856626 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 19/39] 10.222.0.13 () {60 vars in 1190 bytes} [Wed Aug 31 09:41:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 460 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 09:41:30.863472 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-be631eec-64c4-40c9-94c0-0fd19a39f53d admin admin] Calling method '>' {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:30.888679 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-be631eec-64c4-40c9-94c0-0fd19a39f53d admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028745 Aug 31 09:41:30.889250 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 21/40] 10.222.0.13 () {60 vars in 1210 bytes} [Wed Aug 31 09:41:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:41:30.901803 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-061c4ef5-555c-4c17-8f8c-026c48cebd13 admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:30.929622 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-061c4ef5-555c-4c17-8f8c-026c48cebd13 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.033286 Aug 31 09:41:30.930197 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 20/41] 10.222.0.13 () {60 vars in 1210 bytes} [Wed Aug 31 09:41:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:41:30.941068 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-b4b729f9-7b91-42c7-8be0-69eef8562c3b admin admin] Calling method '>' {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:30.946986 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.wsgi [None req-b4b729f9-7b91-42c7-8be0-69eef8562c3b admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 09:41:30.950311 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-b4b729f9-7b91-42c7-8be0-69eef8562c3b admin admin] Request method failure captured: Aug 31 09:41:30.950311 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 09:41:30.950311 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: Accept: application/json Aug 31 09:41:30.950311 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: Accept-Encoding: gzip, deflate Aug 31 09:41:30.950311 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: Connection: keep-alive Aug 31 09:41:30.950311 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: Content-Length: 0 Aug 31 09:41:30.950311 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: Host: 10.222.0.13 Aug 31 09:41:30.950311 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: Openstack-Api-Version: compute 2.90 Aug 31 09:41:30.950311 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: Openstack-System-Scope: None Aug 31 09:41:30.950311 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: User-Agent: python-novaclient Aug 31 09:41:30.950311 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Auth-Token: gAAAAABjDyzK4y-sPQP4XUoDDtNlhMp6EXhoT3G5Txh2LpvM4cUxvmkLY7voQ0osa2khGnQplGXF6_I8ylx6XvvnxtqbFcCU5WK2NHlueima3WUCd_aKJEO_PI532yc1db1Hnay6HiNtYj2vprW78TWo3wh9MKuQFRbRMIQbrzso-w1t0r2DPsQ Aug 31 09:41:30.950311 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Domain-Id: None Aug 31 09:41:30.950311 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Domain-Name: None Aug 31 09:41:30.950311 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Identity-Status: Confirmed Aug 31 09:41:30.950311 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Is-Admin-Project: True Aug 31 09:41:30.950311 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 09:41:30.950311 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Project-Domain-Id: default Aug 31 09:41:30.950311 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Project-Domain-Name: Default Aug 31 09:41:30.950311 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Project-Id: 3f187a2ac46b4c229b4eeead01522f05 Aug 31 09:41:30.950311 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Project-Name: admin Aug 31 09:41:30.950311 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Role: admin,member,reader Aug 31 09:41:30.950311 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Roles: admin,member,reader Aug 31 09:41:30.952601 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3f187a2ac46b4c229b4eeead01522f05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3f187a2ac46b4c229b4eeead01522f05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3f187a2ac46b4c229b4eeead01522f05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3f187a2ac46b4c229b4eeead01522f05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:41:30.952601 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Tenant: admin Aug 31 09:41:30.952601 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Tenant-Id: 3f187a2ac46b4c229b4eeead01522f05 Aug 31 09:41:30.952601 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Tenant-Name: admin Aug 31 09:41:30.952601 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-User: admin Aug 31 09:41:30.952601 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-User-Domain-Id: default Aug 31 09:41:30.952601 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-User-Domain-Name: Default Aug 31 09:41:30.952601 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-User-Id: fd836cf590a145df9acf19cf3ae2ac56 Aug 31 09:41:30.952601 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-User-Name: admin Aug 31 09:41:30.952601 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: method: > Aug 31 09:41:30.952601 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: exception: Flavor 42 could not be found. Aug 31 09:41:30.952601 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: action_args: {'id': '42'} Aug 31 09:41:30.952601 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:41:30.952601 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:41:30.954275 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 09:41:30.954275 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 09:41:30.954275 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 09:41:30.954275 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 09:41:30.954275 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 09:41:30.954275 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 09:41:30.954275 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 09:41:30.954275 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 09:41:30.954275 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 09:41:30.954275 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:41:30.954275 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 09:41:30.954275 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 09:41:30.954275 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 09:41:30.954275 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi Aug 31 09:41:30.954275 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:41:30.954275 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi Aug 31 09:41:30.954275 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:41:30.954275 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:41:30.954275 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:41:30.955902 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:41:30.955902 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:41:30.955902 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:41:30.955902 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:41:30.955902 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 09:41:30.955902 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:41:30.955902 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 09:41:30.955902 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi Aug 31 09:41:30.955902 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:41:30.955902 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi Aug 31 09:41:30.955902 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:41:30.955902 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:41:30.955902 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:41:30.955902 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:41:30.955902 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:41:30.955902 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 09:41:30.955902 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi Aug 31 09:41:30.955902 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-b4b729f9-7b91-42c7-8be0-69eef8562c3b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:41:30.958013 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-b4b729f9-7b91-42c7-8be0-69eef8562c3b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015442 Aug 31 09:41:30.958013 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 22/42] 10.222.0.13 () {60 vars in 1190 bytes} [Wed Aug 31 09:41:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 09:41:31.992112 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-061c4ef5-555c-4c17-8f8c-026c48cebd13 admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:31.993129 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-061c4ef5-555c-4c17-8f8c-026c48cebd13 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 31 09:41:31.993592 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 21/43] 10.222.0.13 () {56 vars in 1074 bytes} [Wed Aug 31 09:41:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:41:32.639164 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-74b5adf7-214c-4eba-9ed0-94e032ad39e8 admin admin] Calling method '>' {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:32.646552 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.wsgi [None req-74b5adf7-214c-4eba-9ed0-94e032ad39e8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 09:41:32.648102 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-74b5adf7-214c-4eba-9ed0-94e032ad39e8 admin admin] Request method failure captured: Aug 31 09:41:32.648102 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 09:41:32.648102 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: Accept: application/json Aug 31 09:41:32.648102 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: Accept-Encoding: gzip, deflate Aug 31 09:41:32.648102 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: Connection: keep-alive Aug 31 09:41:32.648102 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: Content-Length: 0 Aug 31 09:41:32.648102 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: Host: 10.222.0.13 Aug 31 09:41:32.648102 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: Openstack-Api-Version: compute 2.90 Aug 31 09:41:32.648102 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: Openstack-System-Scope: None Aug 31 09:41:32.648102 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: User-Agent: python-novaclient Aug 31 09:41:32.648102 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Auth-Token: gAAAAABjDyzLYf5xyWn_ralK1IEogRABkP6tLHhvqyFuAR5VGj64roBh46M53Re7zjwCYcaS6HrwjTOgSOehRULfppzU8gSD6UfGOgApwAZs5UYb-BOA1hpZxmWQ5LRFbMT8gn5USxIVVgshW3Ios_2gIui_mh172Ocwlx3LASvfOyL_5Zxg6Hs Aug 31 09:41:32.648102 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Domain-Id: None Aug 31 09:41:32.648102 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Domain-Name: None Aug 31 09:41:32.648102 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Identity-Status: Confirmed Aug 31 09:41:32.648102 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Is-Admin-Project: True Aug 31 09:41:32.648102 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 09:41:32.648102 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Project-Domain-Id: default Aug 31 09:41:32.648102 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Project-Domain-Name: Default Aug 31 09:41:32.648102 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Project-Id: 3f187a2ac46b4c229b4eeead01522f05 Aug 31 09:41:32.648102 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Project-Name: admin Aug 31 09:41:32.648102 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Role: admin,member,reader Aug 31 09:41:32.648102 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Roles: admin,member,reader Aug 31 09:41:32.649794 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3f187a2ac46b4c229b4eeead01522f05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3f187a2ac46b4c229b4eeead01522f05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3f187a2ac46b4c229b4eeead01522f05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3f187a2ac46b4c229b4eeead01522f05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:41:32.649794 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Tenant: admin Aug 31 09:41:32.649794 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Tenant-Id: 3f187a2ac46b4c229b4eeead01522f05 Aug 31 09:41:32.649794 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Tenant-Name: admin Aug 31 09:41:32.649794 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-User: admin Aug 31 09:41:32.649794 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-User-Domain-Id: default Aug 31 09:41:32.649794 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-User-Domain-Name: Default Aug 31 09:41:32.649794 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-User-Id: fd836cf590a145df9acf19cf3ae2ac56 Aug 31 09:41:32.649794 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-User-Name: admin Aug 31 09:41:32.649794 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: method: > Aug 31 09:41:32.649794 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: exception: Flavor 84 could not be found. Aug 31 09:41:32.649794 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: action_args: {'id': '84'} Aug 31 09:41:32.649794 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:41:32.649794 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:41:32.650676 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 09:41:32.650676 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 09:41:32.650676 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 09:41:32.650676 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 09:41:32.650676 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 09:41:32.650676 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 09:41:32.650676 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 09:41:32.650676 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 09:41:32.650676 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 09:41:32.650676 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:41:32.650676 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 09:41:32.650676 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 09:41:32.650676 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 09:41:32.650676 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi Aug 31 09:41:32.650676 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:41:32.650676 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi Aug 31 09:41:32.650676 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:41:32.650676 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:41:32.650676 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:41:32.651973 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:41:32.651973 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:41:32.651973 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:41:32.651973 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:41:32.651973 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 09:41:32.651973 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:41:32.651973 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 09:41:32.651973 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi Aug 31 09:41:32.651973 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:41:32.651973 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi Aug 31 09:41:32.651973 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:41:32.651973 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:41:32.651973 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:41:32.651973 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:41:32.651973 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:41:32.651973 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 09:41:32.651973 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi Aug 31 09:41:32.651973 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-74b5adf7-214c-4eba-9ed0-94e032ad39e8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:41:32.653064 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-74b5adf7-214c-4eba-9ed0-94e032ad39e8 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.514815 Aug 31 09:41:32.653064 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 23/44] 10.222.0.13 () {60 vars in 1190 bytes} [Wed Aug 31 09:41:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 516 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 09:41:32.663381 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-2ead3661-0298-4dbe-8dd6-27a892db3d9c admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:32.680218 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-2ead3661-0298-4dbe-8dd6-27a892db3d9c admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022207 Aug 31 09:41:32.680787 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 22/45] 10.222.0.13 () {60 vars in 1210 bytes} [Wed Aug 31 09:41:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:41:32.691248 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-1d5e83be-6ce0-4ba3-8056-ea6e411a205a admin admin] Calling method '>' {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:32.710565 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-1d5e83be-6ce0-4ba3-8056-ea6e411a205a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022832 Aug 31 09:41:32.711129 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1210 bytes} [Wed Aug 31 09:41:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:41:32.721345 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-e07edef0-c2d5-41a9-81ae-c498267c47bc admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:32.727535 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.wsgi [None req-e07edef0-c2d5-41a9-81ae-c498267c47bc admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 09:41:32.729060 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-e07edef0-c2d5-41a9-81ae-c498267c47bc admin admin] Request method failure captured: Aug 31 09:41:32.729060 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 09:41:32.729060 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: Accept: application/json Aug 31 09:41:32.729060 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: Accept-Encoding: gzip, deflate Aug 31 09:41:32.729060 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: Connection: keep-alive Aug 31 09:41:32.729060 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: Content-Length: 0 Aug 31 09:41:32.729060 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: Host: 10.222.0.13 Aug 31 09:41:32.729060 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: Openstack-Api-Version: compute 2.90 Aug 31 09:41:32.729060 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: Openstack-System-Scope: None Aug 31 09:41:32.729060 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: User-Agent: python-novaclient Aug 31 09:41:32.729060 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Auth-Token: gAAAAABjDyzLYf5xyWn_ralK1IEogRABkP6tLHhvqyFuAR5VGj64roBh46M53Re7zjwCYcaS6HrwjTOgSOehRULfppzU8gSD6UfGOgApwAZs5UYb-BOA1hpZxmWQ5LRFbMT8gn5USxIVVgshW3Ios_2gIui_mh172Ocwlx3LASvfOyL_5Zxg6Hs Aug 31 09:41:32.729060 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Domain-Id: None Aug 31 09:41:32.729060 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Domain-Name: None Aug 31 09:41:32.729060 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Identity-Status: Confirmed Aug 31 09:41:32.729060 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Is-Admin-Project: True Aug 31 09:41:32.729060 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 09:41:32.729060 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Project-Domain-Id: default Aug 31 09:41:32.729060 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Project-Domain-Name: Default Aug 31 09:41:32.729060 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Project-Id: 3f187a2ac46b4c229b4eeead01522f05 Aug 31 09:41:32.729060 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Project-Name: admin Aug 31 09:41:32.729060 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Role: admin,member,reader Aug 31 09:41:32.729060 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Roles: admin,member,reader Aug 31 09:41:32.730724 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3f187a2ac46b4c229b4eeead01522f05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3f187a2ac46b4c229b4eeead01522f05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3f187a2ac46b4c229b4eeead01522f05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3f187a2ac46b4c229b4eeead01522f05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:41:32.730724 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Tenant: admin Aug 31 09:41:32.730724 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Tenant-Id: 3f187a2ac46b4c229b4eeead01522f05 Aug 31 09:41:32.730724 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Tenant-Name: admin Aug 31 09:41:32.730724 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-User: admin Aug 31 09:41:32.730724 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-User-Domain-Id: default Aug 31 09:41:32.730724 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-User-Domain-Name: Default Aug 31 09:41:32.730724 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-User-Id: fd836cf590a145df9acf19cf3ae2ac56 Aug 31 09:41:32.730724 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-User-Name: admin Aug 31 09:41:32.730724 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: method: > Aug 31 09:41:32.730724 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: exception: Flavor 84 could not be found. Aug 31 09:41:32.730724 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: action_args: {'id': '84'} Aug 31 09:41:32.730724 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:41:32.730724 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:41:32.731635 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 09:41:32.731635 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 09:41:32.731635 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 09:41:32.731635 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 09:41:32.731635 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 09:41:32.731635 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 09:41:32.731635 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 09:41:32.731635 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 09:41:32.731635 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 09:41:32.731635 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:41:32.731635 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 09:41:32.731635 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 09:41:32.731635 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 09:41:32.731635 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi Aug 31 09:41:32.731635 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:41:32.731635 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi Aug 31 09:41:32.731635 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:41:32.731635 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:41:32.731635 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:41:32.732924 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:41:32.732924 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:41:32.732924 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:41:32.732924 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:41:32.732924 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 09:41:32.732924 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:41:32.732924 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 09:41:32.732924 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi Aug 31 09:41:32.732924 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:41:32.732924 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi Aug 31 09:41:32.732924 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:41:32.732924 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:41:32.732924 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:41:32.732924 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:41:32.732924 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:41:32.732924 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 09:41:32.732924 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi Aug 31 09:41:32.732924 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-e07edef0-c2d5-41a9-81ae-c498267c47bc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:41:32.734187 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-e07edef0-c2d5-41a9-81ae-c498267c47bc admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013117 Aug 31 09:41:32.734187 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 23/47] 10.222.0.13 () {60 vars in 1190 bytes} [Wed Aug 31 09:41:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 09:41:33.776882 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-1d5e83be-6ce0-4ba3-8056-ea6e411a205a admin admin] Calling method '>' {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:33.777936 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-1d5e83be-6ce0-4ba3-8056-ea6e411a205a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Aug 31 09:41:33.778338 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 25/48] 10.222.0.13 () {56 vars in 1074 bytes} [Wed Aug 31 09:41:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:41:34.416124 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-e5c7a59f-706c-4a1f-8f61-ff1e44372b7b admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:34.424018 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.wsgi [None req-e5c7a59f-706c-4a1f-8f61-ff1e44372b7b admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 09:41:34.426253 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-e5c7a59f-706c-4a1f-8f61-ff1e44372b7b admin admin] Request method failure captured: Aug 31 09:41:34.426253 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 09:41:34.426253 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: Accept: application/json Aug 31 09:41:34.426253 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: Accept-Encoding: gzip, deflate Aug 31 09:41:34.426253 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: Connection: keep-alive Aug 31 09:41:34.426253 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: Content-Length: 0 Aug 31 09:41:34.426253 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: Host: 10.222.0.13 Aug 31 09:41:34.426253 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: Openstack-Api-Version: compute 2.90 Aug 31 09:41:34.426253 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: Openstack-System-Scope: None Aug 31 09:41:34.426253 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: User-Agent: python-novaclient Aug 31 09:41:34.426253 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Auth-Token: gAAAAABjDyzNrb6yVTQcTk0vMfHz0WAt6jFZRdG0XB0YL3666P0DgG0jAPaxHyEx3q2Fwy2QX0AZ9QYl1Yv3sKGDy7Q8o46VgrdkUI0zMTS7CvUgUHgQqi8ZAwil06iFhqpbcyLdD1T47CEoOR7jQfW2wyaqhPZUsQnK-MIvNOv1r29sEci3uaE Aug 31 09:41:34.426253 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Domain-Id: None Aug 31 09:41:34.426253 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Domain-Name: None Aug 31 09:41:34.426253 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Identity-Status: Confirmed Aug 31 09:41:34.426253 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Is-Admin-Project: True Aug 31 09:41:34.426253 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 09:41:34.426253 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Project-Domain-Id: default Aug 31 09:41:34.426253 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Project-Domain-Name: Default Aug 31 09:41:34.426253 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Project-Id: 3f187a2ac46b4c229b4eeead01522f05 Aug 31 09:41:34.426253 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Project-Name: admin Aug 31 09:41:34.426253 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Role: admin,member,reader Aug 31 09:41:34.426253 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Roles: admin,member,reader Aug 31 09:41:34.427723 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3f187a2ac46b4c229b4eeead01522f05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3f187a2ac46b4c229b4eeead01522f05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3f187a2ac46b4c229b4eeead01522f05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3f187a2ac46b4c229b4eeead01522f05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:41:34.427723 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Tenant: admin Aug 31 09:41:34.427723 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Tenant-Id: 3f187a2ac46b4c229b4eeead01522f05 Aug 31 09:41:34.427723 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-Tenant-Name: admin Aug 31 09:41:34.427723 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-User: admin Aug 31 09:41:34.427723 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-User-Domain-Id: default Aug 31 09:41:34.427723 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-User-Domain-Name: Default Aug 31 09:41:34.427723 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-User-Id: fd836cf590a145df9acf19cf3ae2ac56 Aug 31 09:41:34.427723 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: X-User-Name: admin Aug 31 09:41:34.427723 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: method: > Aug 31 09:41:34.427723 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: exception: Flavor 451 could not be found. Aug 31 09:41:34.427723 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: action_args: {'id': '451'} Aug 31 09:41:34.427723 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:41:34.427723 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:41:34.428561 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 09:41:34.428561 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 09:41:34.428561 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 09:41:34.428561 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 09:41:34.428561 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 09:41:34.428561 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 09:41:34.428561 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 09:41:34.428561 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 09:41:34.428561 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 09:41:34.428561 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:41:34.428561 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 09:41:34.428561 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 09:41:34.428561 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 09:41:34.428561 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi Aug 31 09:41:34.428561 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:41:34.428561 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi Aug 31 09:41:34.428561 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:41:34.428561 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:41:34.428561 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:41:34.429756 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:41:34.429756 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:41:34.429756 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:41:34.429756 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:41:34.429756 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 09:41:34.429756 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:41:34.429756 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 09:41:34.429756 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi Aug 31 09:41:34.429756 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:41:34.429756 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi Aug 31 09:41:34.429756 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:41:34.429756 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:41:34.429756 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:41:34.429756 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:41:34.429756 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:41:34.429756 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 09:41:34.429756 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: ERROR nova.api.openstack.wsgi Aug 31 09:41:34.429756 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-e5c7a59f-706c-4a1f-8f61-ff1e44372b7b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:41:34.431134 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-e5c7a59f-706c-4a1f-8f61-ff1e44372b7b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.509357 Aug 31 09:41:34.431134 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 24/49] 10.222.0.13 () {60 vars in 1193 bytes} [Wed Aug 31 09:41:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 511 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 09:41:34.440763 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-9a442034-1072-44cb-bdaf-20b50b327f91 admin admin] Calling method '>' {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:34.458807 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-9a442034-1072-44cb-bdaf-20b50b327f91 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023767 Aug 31 09:41:34.459387 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 26/50] 10.222.0.13 () {60 vars in 1210 bytes} [Wed Aug 31 09:41:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:41:34.469516 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-587b97d9-3048-4420-bdd3-358a9c0552f1 admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:34.486451 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-587b97d9-3048-4420-bdd3-358a9c0552f1 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020622 Aug 31 09:41:34.487034 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 25/51] 10.222.0.13 () {60 vars in 1210 bytes} [Wed Aug 31 09:41:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:41:34.498759 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-f9e58ea1-5c1c-4747-9678-7cedb22642cb admin admin] Calling method '>' {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:34.506911 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.wsgi [None req-f9e58ea1-5c1c-4747-9678-7cedb22642cb admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 09:41:34.509108 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-f9e58ea1-5c1c-4747-9678-7cedb22642cb admin admin] Request method failure captured: Aug 31 09:41:34.509108 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 09:41:34.509108 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: Accept: application/json Aug 31 09:41:34.509108 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: Accept-Encoding: gzip, deflate Aug 31 09:41:34.509108 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: Connection: keep-alive Aug 31 09:41:34.509108 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: Content-Length: 0 Aug 31 09:41:34.509108 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: Host: 10.222.0.13 Aug 31 09:41:34.509108 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: Openstack-Api-Version: compute 2.90 Aug 31 09:41:34.509108 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: Openstack-System-Scope: None Aug 31 09:41:34.509108 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: User-Agent: python-novaclient Aug 31 09:41:34.509108 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Auth-Token: gAAAAABjDyzNrb6yVTQcTk0vMfHz0WAt6jFZRdG0XB0YL3666P0DgG0jAPaxHyEx3q2Fwy2QX0AZ9QYl1Yv3sKGDy7Q8o46VgrdkUI0zMTS7CvUgUHgQqi8ZAwil06iFhqpbcyLdD1T47CEoOR7jQfW2wyaqhPZUsQnK-MIvNOv1r29sEci3uaE Aug 31 09:41:34.509108 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Domain-Id: None Aug 31 09:41:34.509108 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Domain-Name: None Aug 31 09:41:34.509108 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Identity-Status: Confirmed Aug 31 09:41:34.509108 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Is-Admin-Project: True Aug 31 09:41:34.509108 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 09:41:34.509108 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Project-Domain-Id: default Aug 31 09:41:34.509108 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Project-Domain-Name: Default Aug 31 09:41:34.509108 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Project-Id: 3f187a2ac46b4c229b4eeead01522f05 Aug 31 09:41:34.509108 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Project-Name: admin Aug 31 09:41:34.509108 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Role: admin,member,reader Aug 31 09:41:34.509108 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Roles: admin,member,reader Aug 31 09:41:34.510987 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3f187a2ac46b4c229b4eeead01522f05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3f187a2ac46b4c229b4eeead01522f05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3f187a2ac46b4c229b4eeead01522f05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3f187a2ac46b4c229b4eeead01522f05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:41:34.510987 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Tenant: admin Aug 31 09:41:34.510987 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Tenant-Id: 3f187a2ac46b4c229b4eeead01522f05 Aug 31 09:41:34.510987 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-Tenant-Name: admin Aug 31 09:41:34.510987 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-User: admin Aug 31 09:41:34.510987 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-User-Domain-Id: default Aug 31 09:41:34.510987 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-User-Domain-Name: Default Aug 31 09:41:34.510987 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-User-Id: fd836cf590a145df9acf19cf3ae2ac56 Aug 31 09:41:34.510987 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: X-User-Name: admin Aug 31 09:41:34.510987 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: method: > Aug 31 09:41:34.510987 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: exception: Flavor 451 could not be found. Aug 31 09:41:34.510987 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: action_args: {'id': '451'} Aug 31 09:41:34.510987 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:41:34.510987 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:41:34.512073 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 09:41:34.512073 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 09:41:34.512073 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 09:41:34.512073 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 09:41:34.512073 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 09:41:34.512073 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 09:41:34.512073 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 09:41:34.512073 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 09:41:34.512073 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 09:41:34.512073 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:41:34.512073 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 09:41:34.512073 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 09:41:34.512073 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 09:41:34.512073 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi Aug 31 09:41:34.512073 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:41:34.512073 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi Aug 31 09:41:34.512073 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:41:34.512073 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:41:34.512073 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:41:34.513152 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:41:34.513152 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:41:34.513152 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:41:34.513152 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:41:34.513152 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 09:41:34.513152 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:41:34.513152 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 09:41:34.513152 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi Aug 31 09:41:34.513152 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:41:34.513152 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi Aug 31 09:41:34.513152 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:41:34.513152 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:41:34.513152 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:41:34.513152 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:41:34.513152 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:41:34.513152 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 09:41:34.513152 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: ERROR nova.api.openstack.wsgi Aug 31 09:41:34.513152 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-f9e58ea1-5c1c-4747-9678-7cedb22642cb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:41:34.514737 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-f9e58ea1-5c1c-4747-9678-7cedb22642cb admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.017955 Aug 31 09:41:34.514737 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 27/52] 10.222.0.13 () {60 vars in 1193 bytes} [Wed Aug 31 09:41:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 09:41:35.542502 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-587b97d9-3048-4420-bdd3-358a9c0552f1 admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:35.543516 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-587b97d9-3048-4420-bdd3-358a9c0552f1 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 31 09:41:35.543928 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1074 bytes} [Wed Aug 31 09:41:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:41:36.157909 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-0d59e394-09f1-409c-abf6-da780c81727d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:36.177408 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-0d59e394-09f1-409c-abf6-da780c81727d admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.487213 Aug 31 09:41:36.177988 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 28/54] 10.222.0.13 () {64 vars in 1235 bytes} [Wed Aug 31 09:41:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:41:37.190732 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-587b97d9-3048-4420-bdd3-358a9c0552f1 admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:37.191750 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-587b97d9-3048-4420-bdd3-358a9c0552f1 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 31 09:41:37.192175 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 27/55] 10.222.0.13 () {56 vars in 1074 bytes} [Wed Aug 31 09:41:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:41:37.777451 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-3da4efe9-1cac-4812-8b79-8928f6c05f65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:37.798227 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-3da4efe9-1cac-4812-8b79-8928f6c05f65 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.465020 Aug 31 09:41:37.798792 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 29/56] 10.222.0.13 () {64 vars in 1235 bytes} [Wed Aug 31 09:41:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:41:38.854660 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-587b97d9-3048-4420-bdd3-358a9c0552f1 admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:38.856111 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-587b97d9-3048-4420-bdd3-358a9c0552f1 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002673 Aug 31 09:41:38.856524 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 28/57] 10.222.0.13 () {56 vars in 1074 bytes} [Wed Aug 31 09:41:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:41:39.432350 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-18a98626-3e56-4703-b488-21759ea416da admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:39.451809 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-18a98626-3e56-4703-b488-21759ea416da admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.447813 Aug 31 09:41:39.453012 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 30/58] 10.222.0.13 () {64 vars in 1235 bytes} [Wed Aug 31 09:41:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 09:41:40.484914 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-587b97d9-3048-4420-bdd3-358a9c0552f1 admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:40.485956 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-587b97d9-3048-4420-bdd3-358a9c0552f1 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001869 Aug 31 09:41:40.486357 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 29/59] 10.222.0.13 () {56 vars in 1074 bytes} [Wed Aug 31 09:41:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:41:41.095959 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-4d60985f-0903-468c-a0b1-0db6d8860081 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:41.117527 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-4d60985f-0903-468c-a0b1-0db6d8860081 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.483674 Aug 31 09:41:41.118301 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 31/60] 10.222.0.13 () {64 vars in 1235 bytes} [Wed Aug 31 09:41:40 2022] POST /compute/v2.1/flavors => generated 409 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 09:41:42.184856 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-587b97d9-3048-4420-bdd3-358a9c0552f1 admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:42.185951 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-587b97d9-3048-4420-bdd3-358a9c0552f1 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Aug 31 09:41:42.187731 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 30/61] 10.222.0.13 () {56 vars in 1074 bytes} [Wed Aug 31 09:41:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:41:42.800553 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-6c0c470b-fc04-48bd-b761-eafa68fe857a admin admin] Calling method '>' {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:42.822672 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-6c0c470b-fc04-48bd-b761-eafa68fe857a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.452923 Aug 31 09:41:42.823234 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 32/62] 10.222.0.13 () {60 vars in 1202 bytes} [Wed Aug 31 09:41:42 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:42:38.330639 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-587b97d9-3048-4420-bdd3-358a9c0552f1 admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:38.331586 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-587b97d9-3048-4420-bdd3-358a9c0552f1 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Aug 31 09:42:38.331980 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 31/63] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 31 09:42:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:42:38.343385 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG dbcounter [-] [112133] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:42:38.741558 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-d7538ff0-76c3-4446-b3db-636d5acd0fe9 admin admin] Calling method '>' {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:38.763412 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-d7538ff0-76c3-4446-b3db-636d5acd0fe9 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.424472 Aug 31 09:42:38.763958 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 33/64] 10.222.0.13 () {60 vars in 1292 bytes} [Wed Aug 31 09:42:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:42:38.785320 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG dbcounter [-] [112134] Writing DB stats nova_api:SELECT=14 {{(pid=112134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:42:38.789140 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-bc4f94b5-7d1a-4562-b12a-da421f407db1 admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:38.796734 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-bc4f94b5-7d1a-4562-b12a-da421f407db1 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012933 Aug 31 09:42:38.797269 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 32/65] 10.222.0.13 () {60 vars in 1283 bytes} [Wed Aug 31 09:42:38 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:42:38.809351 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-f0c0aac0-8eec-41a2-bb31-84bbc3ac17d0 admin admin] Calling method '>' {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:38.818103 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-f0c0aac0-8eec-41a2-bb31-84bbc3ac17d0 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012513 Aug 31 09:42:38.818676 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 34/66] 10.222.0.13 () {60 vars in 1286 bytes} [Wed Aug 31 09:42:38 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:42:38.832900 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-dc19c566-98a1-4cf7-a0a8-06227f83c645 admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:38.841340 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-dc19c566-98a1-4cf7-a0a8-06227f83c645 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011340 Aug 31 09:42:38.841853 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 33/67] 10.222.0.13 () {60 vars in 1286 bytes} [Wed Aug 31 09:42:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:42:38.854134 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-251005e6-4a1b-4a28-b8d3-d6ffd3a618d3 admin admin] Calling method '>' {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:38.863117 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-251005e6-4a1b-4a28-b8d3-d6ffd3a618d3 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012702 Aug 31 09:42:38.863664 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 35/68] 10.222.0.13 () {60 vars in 1283 bytes} [Wed Aug 31 09:42:38 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:45:46.025530 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-dc19c566-98a1-4cf7-a0a8-06227f83c645 admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:45:46.026551 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-dc19c566-98a1-4cf7-a0a8-06227f83c645 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002389 Aug 31 09:45:46.026952 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 34/69] 10.222.0.13 () {56 vars in 1074 bytes} [Wed Aug 31 09:45:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:45:46.174056 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG dbcounter [-] [112133] Writing DB stats nova_api:SELECT=6 {{(pid=112133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:46.328259 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-c8df1f78-ec84-4384-b10b-4c01072510ef admin admin] Calling method '>' {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:45:46.331838 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-c8df1f78-ec84-4384-b10b-4c01072510ef admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:45:46.332305 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-c8df1f78-ec84-4384-b10b-4c01072510ef admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:45:46.332725 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-c8df1f78-ec84-4384-b10b-4c01072510ef admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:45:46.333448 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-c8df1f78-ec84-4384-b10b-4c01072510ef admin admin] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:45:46.333891 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-c8df1f78-ec84-4384-b10b-4c01072510ef admin admin] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:45:46.334307 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-c8df1f78-ec84-4384-b10b-4c01072510ef admin admin] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:45:46.368663 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-c8df1f78-ec84-4384-b10b-4c01072510ef admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.199037 Aug 31 09:45:46.369225 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 36/70] 10.222.0.13 () {60 vars in 1193 bytes} [Wed Aug 31 09:45:46 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:45:47.193405 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-dc19c566-98a1-4cf7-a0a8-06227f83c645 admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:45:47.194431 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-dc19c566-98a1-4cf7-a0a8-06227f83c645 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 31 09:45:47.194823 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 35/71] 10.222.0.13 () {56 vars in 1074 bytes} [Wed Aug 31 09:45:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:45:47.393357 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-50fe6e1f-a106-4a0b-a423-0df2d50d8a6f admin admin] Calling method '>' {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:45:47.396764 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-50fe6e1f-a106-4a0b-a423-0df2d50d8a6f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:45:47.397239 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-50fe6e1f-a106-4a0b-a423-0df2d50d8a6f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:45:47.397693 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-50fe6e1f-a106-4a0b-a423-0df2d50d8a6f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:45:47.398407 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-50fe6e1f-a106-4a0b-a423-0df2d50d8a6f admin admin] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:45:47.398849 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-50fe6e1f-a106-4a0b-a423-0df2d50d8a6f admin admin] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:45:47.400313 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-50fe6e1f-a106-4a0b-a423-0df2d50d8a6f admin admin] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:45:47.420925 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-50fe6e1f-a106-4a0b-a423-0df2d50d8a6f admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080287 Aug 31 09:45:47.421587 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 37/72] 10.222.0.13 () {60 vars in 1193 bytes} [Wed Aug 31 09:45:47 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:45:58.667765 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-dc19c566-98a1-4cf7-a0a8-06227f83c645 admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:45:58.668764 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-dc19c566-98a1-4cf7-a0a8-06227f83c645 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Aug 31 09:45:58.669154 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 36/73] 10.222.0.13 () {56 vars in 1074 bytes} [Wed Aug 31 09:45:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:45:58.814222 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG dbcounter [-] [112133] Writing DB stats nova_cell0:SELECT=4 {{(pid=112133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:58.814941 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG dbcounter [-] [112133] Writing DB stats nova_cell1:SELECT=4 {{(pid=112133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:58.815547 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG dbcounter [-] [112133] Writing DB stats nova_api:SELECT=8 {{(pid=112133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:58.866342 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-f9905615-7294-4ce4-98fb-ee36c1126707 admin admin] Calling method '>' {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:45:58.869884 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-f9905615-7294-4ce4-98fb-ee36c1126707 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:45:58.870364 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-f9905615-7294-4ce4-98fb-ee36c1126707 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:45:58.870793 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-f9905615-7294-4ce4-98fb-ee36c1126707 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:45:58.871513 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-f9905615-7294-4ce4-98fb-ee36c1126707 admin admin] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:45:58.871957 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-f9905615-7294-4ce4-98fb-ee36c1126707 admin admin] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:45:58.872373 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-f9905615-7294-4ce4-98fb-ee36c1126707 admin admin] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:45:58.897288 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-f9905615-7294-4ce4-98fb-ee36c1126707 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087395 Aug 31 09:45:58.897811 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 38/74] 10.222.0.13 () {60 vars in 1193 bytes} [Wed Aug 31 09:45:58 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:45:59.735183 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: DEBUG nova.api.openstack.wsgi [None req-dc19c566-98a1-4cf7-a0a8-06227f83c645 admin admin] Calling method '>' {{(pid=112134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:45:59.736239 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: INFO nova.api.openstack.requestlog [None req-dc19c566-98a1-4cf7-a0a8-06227f83c645 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 31 09:45:59.736643 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: [pid: 112134|app: 0|req: 37/75] 10.222.0.13 () {56 vars in 1074 bytes} [Wed Aug 31 09:45:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:45:59.930542 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG nova.api.openstack.wsgi [None req-25924953-086d-483d-93b0-c42303ebf951 admin admin] Calling method '>' {{(pid=112133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:45:59.934008 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-25924953-086d-483d-93b0-c42303ebf951 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:45:59.934477 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-25924953-086d-483d-93b0-c42303ebf951 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:45:59.934900 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-25924953-086d-483d-93b0-c42303ebf951 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:45:59.935604 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-25924953-086d-483d-93b0-c42303ebf951 admin admin] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:45:59.936041 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-25924953-086d-483d-93b0-c42303ebf951 admin admin] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:45:59.936456 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: DEBUG oslo_concurrency.lockutils [None req-25924953-086d-483d-93b0-c42303ebf951 admin admin] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:45:59.959984 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: INFO nova.api.openstack.requestlog [None req-25924953-086d-483d-93b0-c42303ebf951 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082370 Aug 31 09:45:59.960462 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: [pid: 112133|app: 0|req: 39/76] 10.222.0.13 () {60 vars in 1193 bytes} [Wed Aug 31 09:45:59 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:02.295234 dv-cinder-844961-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 31 09:47:02.296108 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: Wed Aug 31 09:47:02 2022 - graceful shutdown triggered... Aug 31 09:47:02.296586 dv-cinder-844961-2-iscsi devstack@n-api.service[112133]: Gracefully killing worker 1 (pid: 112133)... Aug 31 09:47:02.296945 dv-cinder-844961-2-iscsi devstack@n-api.service[112134]: Gracefully killing worker 2 (pid: 112134)... Aug 31 09:47:03.297362 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: worker 1 buried after 1 seconds Aug 31 09:47:03.297362 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: worker 2 buried after 1 seconds Aug 31 09:47:03.297362 dv-cinder-844961-2-iscsi devstack@n-api.service[112132]: goodbye to uWSGI. Aug 31 09:47:03.298951 dv-cinder-844961-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 31 09:47:03.299511 dv-cinder-844961-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 31 09:47:03.302371 dv-cinder-844961-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 09:47:03.312077 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 09:47:03.314143 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 09:47:03 2022] *** Aug 31 09:47:03.314143 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 09:47:03.314143 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 09:47:03.314143 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: nodename: dv-cinder-844961-2-iscsi Aug 31 09:47:03.314143 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: machine: x86_64 Aug 31 09:47:03.314143 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: clock source: unix Aug 31 09:47:03.314143 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: pcre jit disabled Aug 31 09:47:03.314143 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: detected number of CPU cores: 4 Aug 31 09:47:03.314143 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: current working directory: / Aug 31 09:47:03.314143 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: detected binary path: /usr/bin/uwsgi-core Aug 31 09:47:03.314909 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: your processes number limit is 47680 Aug 31 09:47:03.314909 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: your memory page size is 4096 bytes Aug 31 09:47:03.314909 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: detected max file descriptor number: 2048 Aug 31 09:47:03.314909 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: lock engine: pthread robust mutexes Aug 31 09:47:03.314909 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: thunder lock: enabled Aug 31 09:47:03.314909 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 09:47:03.314909 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 09:47:03.354509 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: Python main interpreter initialized at 0x556e2a2789c0 Aug 31 09:47:03.354509 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: python threads support enabled Aug 31 09:47:03.354509 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: your server socket listen backlog is limited to 100 connections Aug 31 09:47:03.354509 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: your mercy for graceful operations on workers is 90 seconds Aug 31 09:47:03.354509 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 09:47:03.354978 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: *** Operational MODE: preforking *** Aug 31 09:47:03.354978 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: *** uWSGI is running in multiple interpreter mode *** Aug 31 09:47:03.354978 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: spawned uWSGI master process (pid: 127157) Aug 31 09:47:03.355104 dv-cinder-844961-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 09:47:03.374501 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: spawned uWSGI worker 1 (pid: 127170, cores: 1) Aug 31 09:47:03.374501 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: spawned uWSGI worker 2 (pid: 127171, cores: 1) Aug 31 09:47:03.374501 dv-cinder-844961-2-iscsi devstack@n-api.service[127157]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 09:47:04.040064 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 09:47:04.047713 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 09:47:05.218551 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:47:05.218551 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: from cryptography.utils import int_from_bytes Aug 31 09:47:05.219195 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:47:05.219195 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: from cryptography.utils import int_from_bytes Aug 31 09:47:05.247199 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:47:05.247199 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: from cryptography.utils import int_from_bytes Aug 31 09:47:05.247886 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:47:05.247886 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: from cryptography.utils import int_from_bytes Aug 31 09:47:07.670355 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 09:47:07.670988 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 09:47:07.671158 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 09:47:07.671525 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 09:47:07.671782 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 09:47:07.672172 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.672499 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.672815 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.673133 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.673664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.673983 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.674309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.674634 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.674964 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.675227 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.675543 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.676173 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844961-2-iscsi {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.676427 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.676742 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.677060 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.677431 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.677715 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.678041 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.678349 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.678880 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.680582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.680582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.680582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.680582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.680958 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.681216 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.681559 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.681884 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.682211 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.682527 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.682941 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844961-2-iscsi {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.683446 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.683751 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.684237 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.684673 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.684991 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.685301 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.685665 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.685992 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.686304 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.686667 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.686969 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.687327 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.687608 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.687912 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.688219 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.688529 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.688860 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.689157 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.689491 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.689744 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.690051 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.690369 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.690688 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.691009 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.691259 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.691507 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.691821 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.692150 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.692458 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.692763 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.693068 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.693372 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.693704 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.694006 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.694314 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.694858 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.695130 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.695374 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.695615 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.695884 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.696204 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.696613 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.696863 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.697169 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.697544 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.697863 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.698173 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.698491 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.698811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.699117 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.699500 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.699809 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.700129 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.700466 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.700771 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.701020 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.701322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.701661 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.701984 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.702299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.702597 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.702905 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.703206 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.703510 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.703818 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.704122 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.704428 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.704734 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.705037 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.705342 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.705670 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.705974 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.706298 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.706619 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.706927 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.707234 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.707542 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.707847 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.708167 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.708473 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.708778 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.709099 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.709432 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.709737 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.710054 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.710905 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.711219 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.711526 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.711826 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.712130 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.712441 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.712748 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.713052 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.713355 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.713693 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.713999 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.714303 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.714605 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.714907 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.715205 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.715526 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.715848 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.716160 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.716466 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.716887 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.717212 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.717576 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.717907 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.718425 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.718750 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.719087 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.719418 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.719738 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.720053 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.720368 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.720692 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.721002 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.721315 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.721660 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.721977 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.722295 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.722632 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.722978 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.723251 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.723568 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.723877 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.724195 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.724522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.724845 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.725156 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.725530 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.726502 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.726767 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.727076 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.727474 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.727695 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.728008 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.728316 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.728638 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.728973 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.729286 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.729631 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.729944 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.730266 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.730578 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.730890 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.731200 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.731513 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.731824 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.732163 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.732482 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.732803 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.733121 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.733456 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.733779 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.734094 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.734407 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.734713 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.735021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.735326 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.735632 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.735944 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.736250 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.736577 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.736907 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.737214 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.737575 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.737879 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.738189 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.738499 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.738806 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.739110 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.739420 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.739727 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.740030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.740350 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.740661 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.740964 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.741286 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.741641 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.741952 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.742267 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.742584 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.742894 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.743206 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.743518 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.743840 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.744152 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.744474 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.744791 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.745118 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.745441 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.745765 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.746086 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.746401 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.746707 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.747016 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.747320 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.747622 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.747922 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.748230 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.748532 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.748833 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.749135 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.749465 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.749769 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.750088 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.750401 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.750575 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 09:47:07.751068 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 09:47:07.751229 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.751229 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.751517 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 09:47:07.751674 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.751834 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 09:47:07.751988 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.752141 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 09:47:07.752295 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.752440 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.752605 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.752760 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.752906 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.753050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.753193 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.753435 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.753622 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.754040 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.754197 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.754344 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.754489 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.754643 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.754838 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.755011 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.755687 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.755854 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.756010 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.756167 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.756325 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.756481 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.756635 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.756781 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.756927 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844961-2-iscsi {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.757652 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.757803 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.757951 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.758114 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.758262 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.758416 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.758576 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.758576 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.758576 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.759010 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.759010 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.759304 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.759466 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.759613 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.759765 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.759911 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.759911 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.760212 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.760377 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.760623 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.760775 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.760920 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.761076 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.761232 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.761451 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.761621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.761776 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.761941 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.762100 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.762256 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.762411 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.762557 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.762702 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.762846 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.763141 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.763337 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.763501 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.763648 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.763800 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.763800 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.764096 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844961-2-iscsi {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.764256 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.764411 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.764557 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.764701 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.764854 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.765008 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.765154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.765874 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.766044 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.766193 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.766348 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.766516 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.766670 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.766825 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.766971 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.767116 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.767261 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.767418 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.767617 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.767779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.767937 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.768082 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.768237 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.768384 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.768547 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.768694 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.768839 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.768990 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.769145 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.769291 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.769466 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.769628 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.769783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.769929 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.770089 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.770244 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.770412 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.770568 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.770805 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.770971 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.771138 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.771390 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.771562 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.771719 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.771866 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.772091 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.772240 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.772393 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.772551 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.773324 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.773527 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.773690 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.773847 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.774007 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.774154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.774298 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.774453 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.774615 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.774772 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.774918 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.775062 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.775217 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.775395 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.775395 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.776219 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.776374 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.776529 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.776683 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.776847 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.776993 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.777139 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.777284 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.777461 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.777638 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.777852 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.778001 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.778154 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.778307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.778461 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.778615 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.778770 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.778928 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.779083 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.779229 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.779382 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.779536 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.779701 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.779848 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.780001 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.780155 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.780309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.780465 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.780618 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.780794 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.781020 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.781172 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.781330 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.781549 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.781708 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.781865 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.782019 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.782165 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.782318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.782473 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.782619 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.782771 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.782916 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.783061 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.783220 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.783367 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.783526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.783679 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.783841 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.783995 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.784151 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.784151 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.784435 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.784581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.784732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.784887 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.785043 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.785198 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.785351 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.785545 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.786223 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.786380 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.786539 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.786695 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.786851 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.787007 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.787153 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.787299 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.787452 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.787605 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.787804 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.787966 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.788121 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.788305 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.788457 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.788625 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.788780 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.788935 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.789089 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.789235 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.789422 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.789587 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.789749 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.789896 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.790048 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.790194 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.790357 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.790511 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.790678 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.790833 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.791018 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.791247 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.791399 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.791553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.791707 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.791707 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.791999 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.792205 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.792352 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.792515 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.792662 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.792815 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.792960 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.793114 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.793268 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.793462 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.793626 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.793774 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.793918 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.794077 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.794224 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.794369 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.794523 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.794678 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.794833 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.794986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.795139 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.795292 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.795445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.795590 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.795750 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.796417 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.796585 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.796734 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.796899 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.797045 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.797204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.797358 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.797540 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.797699 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.797913 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.798076 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.798236 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.798382 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.798526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.798669 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.798815 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.798984 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.799131 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.799283 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.799428 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.799579 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.799725 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.799880 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.800025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.800171 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.800315 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.800468 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.800622 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:07.800790 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.800952 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.801106 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.801268 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.801561 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.801561 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.801943 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.802103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.802258 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.802411 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.802558 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.802718 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.802865 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.803030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.803184 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.803338 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.803491 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.803822 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.804004 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.804152 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.804297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.804453 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.804750 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.804912 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.805058 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.805213 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.805377 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.805560 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.805724 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.805880 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.806575 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.806738 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.806893 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.807040 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.807249 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.807403 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.807548 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.807704 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.807860 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.808069 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.808231 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.808378 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.808523 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.808667 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.808812 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.808965 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.809120 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.809268 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.809268 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.809268 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.809834 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.809997 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.810157 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.810396 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.810546 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.810700 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.810861 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.811022 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.811176 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.811322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.811474 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.811710 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.811863 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.812019 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.812176 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.812332 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.812478 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.812631 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.812785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.812941 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.812941 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.813226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.813417 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.813586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.813749 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.813903 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.814049 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.814213 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.814359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.814512 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.814667 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.814819 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.814965 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.815117 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.815271 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.815426 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.815586 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.815742 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.815888 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.816039 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.816221 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.816833 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.817081 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.817272 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.817467 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.817628 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.817790 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.817951 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.818155 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.818314 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.818466 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.818617 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.818770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.818942 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.819104 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.819256 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.819418 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.820105 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.820426 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.820598 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.820754 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.820909 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.821056 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.821200 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.821352 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.821553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.821730 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.821955 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.822108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.822253 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.822398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.822556 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.822709 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.822854 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.823000 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.823152 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.823308 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.823454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.823610 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.823755 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.823907 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.824053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.824214 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.824380 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.824536 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.824683 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.824828 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.824973 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.825128 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.825274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.825452 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.825616 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.825762 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.825917 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.826065 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.826210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.826373 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.826974 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.827231 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.827231 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.827231 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.827673 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.827828 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.827975 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.828192 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.828357 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.828513 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.828707 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.828859 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.829005 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.829158 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.829354 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.829536 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.829684 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.829830 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.829989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.830157 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.830305 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.830466 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.830612 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.830758 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.830903 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.831058 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.831205 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.831351 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.831531 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.831679 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.831832 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.832013 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.832253 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.832407 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.832561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.832716 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.832862 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.833017 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.833164 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.833317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.833544 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.833693 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.833851 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.834007 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.834162 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.834320 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.834467 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.834620 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.834780 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.834929 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.835073 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.835793 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.836155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.836339 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.836502 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.837144 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.837430 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.837607 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.837774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.837937 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.838172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.838386 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.838547 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.838709 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.838871 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.839039 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.839194 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.839354 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.843771 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.844026 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.844210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.844382 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.844539 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.844695 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.844849 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.845014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.845170 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.845333 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.845561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.845725 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.845888 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.846052 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.846206 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.846379 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.846543 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.846696 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.847618 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.847793 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.847959 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.848123 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.848279 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.848490 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.848649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.848802 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.848969 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.849126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.849292 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.849468 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.849468 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.849778 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.849946 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.849946 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.850259 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.850412 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.850564 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.850755 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.851011 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.851168 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.851331 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.851504 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.851661 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.851829 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.851982 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.852761 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.852939 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.853105 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.853267 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.853481 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.853660 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.853916 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.854077 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.854255 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.854419 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.854584 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.854747 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.854901 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.855053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.855212 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.855373 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.855538 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.855700 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.855854 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.856007 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.856159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.856330 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.856485 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.856637 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.856797 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.856968 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.857761 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.857948 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.858105 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.858265 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.858426 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.858426 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.858772 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.858772 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.858772 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.858772 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.858772 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.858772 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.858772 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.859791 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.859945 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.859945 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.860250 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.860410 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.860563 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.860726 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.860880 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.861050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.861204 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.861356 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.861556 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.861713 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.861874 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.862028 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.862188 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.862340 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.862507 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.862662 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.862814 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.862995 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.863304 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.863481 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.863645 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.863807 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.864055 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.864224 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.864378 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.864530 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.864692 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.864847 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.864998 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.864998 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.865308 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.865561 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.865561 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.865863 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.866017 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.866176 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.866328 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.866615 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.866817 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.866974 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.867129 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.867761 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.868150 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.868336 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.868490 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.868694 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.868854 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.869006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.869168 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.869330 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.869560 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.869937 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.870098 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.870251 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.872879 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.873075 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.873257 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.873475 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.873649 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.873813 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.873977 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.874248 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.874498 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.874666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.874820 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.874981 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.875149 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.875303 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.875456 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.875620 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.875773 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.875925 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.876087 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.876249 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.876403 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.876555 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.876706 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.876868 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.877023 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.877175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.877333 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.878272 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.878440 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.878616 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.879076 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.879234 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.879396 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.879560 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.879715 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.879877 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.880040 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.880193 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.880352 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.880507 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.880673 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.880841 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.880995 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.881156 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.881309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.881503 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.881672 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.881672 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.882515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.882515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.882969 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.883128 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.883291 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.883465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.883650 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.883818 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.883979 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.884132 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.884399 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.884570 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.884725 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.884889 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.885052 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.885212 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.885365 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.885557 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.885710 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.885710 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.886019 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.886178 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.886333 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.886333 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.886640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.886640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.886640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.886640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.887361 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.887521 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.887714 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.888472 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.888644 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.888841 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.889005 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.889157 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.889358 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.889358 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.889694 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.889862 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.890017 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.890169 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.890392 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.890560 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.890713 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.890863 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.891021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.891188 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.891349 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.891503 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.891654 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.891805 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.891962 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.892177 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.892355 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.892508 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.892660 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.892818 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.892978 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.893144 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.893297 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.893483 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.893640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.893801 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.893964 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.894126 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.894287 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.894536 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.894696 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.894850 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.895016 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.895179 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.895341 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.895502 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.895655 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.895814 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.895977 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.896137 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.896137 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.896451 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.896627 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.896781 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.896932 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.897083 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.897236 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.897423 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.897621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.898871 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.899163 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.899337 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.899508 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.899670 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.899846 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.900008 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.900168 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.900321 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.900481 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.900645 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.900799 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.900950 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.901109 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.901263 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.901447 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.901619 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.901773 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.901950 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.902109 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.902260 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.902411 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.902577 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.902732 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.902891 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.903052 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.903211 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.903364 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.903364 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.903664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.903836 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.904002 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.904156 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.904317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.904477 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.904739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.904739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.904739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.905189 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.905189 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.905576 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.905733 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.905896 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.906060 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.906212 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.906378 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.906533 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.906684 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.906845 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.906845 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.907145 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.907306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.907467 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.907619 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.907769 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.907921 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.908093 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.908254 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.908425 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.909144 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.909318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.909500 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.909667 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.909828 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.909989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.910243 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.910411 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.910574 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.910737 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.910903 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.911057 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.911216 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.911370 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.911522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.911753 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.911925 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.912092 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.912254 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.912409 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.912573 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.912726 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.912879 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.913045 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.913206 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.913444 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.913694 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.913884 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.914039 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.914200 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.914361 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.914522 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.914708 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.914941 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.915107 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.915273 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.915433 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.915595 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.915759 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.915920 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.916072 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.916226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.916378 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.916539 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.916692 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.916843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.917073 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.917232 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.917417 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.917590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.917753 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.917906 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.918066 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.918218 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.918380 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.918542 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.918542 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.918542 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.918542 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.918542 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.919880 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.920059 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.920213 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.920372 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.920372 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.920672 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.920672 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.920980 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.921134 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.921285 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.921489 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.921651 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.921813 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.921978 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.922151 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.922312 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.922474 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.922629 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.922801 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.922956 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.923107 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.923259 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.923411 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.923565 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.923726 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.923887 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.924059 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.924212 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.924371 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.924537 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.924691 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.924851 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.925095 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.925255 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.925629 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.925807 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.925962 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.926115 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.926397 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.926553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.926668 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.926799 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.926936 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.927068 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.927199 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.927330 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.927460 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.927601 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.927741 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.927882 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.928014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.928145 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.928324 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.928468 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.928606 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.928747 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.929588 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.929768 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.929949 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.930080 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.930239 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.930373 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.930505 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.930636 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.930777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.930777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.931029 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.931164 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.931331 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.931468 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.931618 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.931618 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.931880 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.932168 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.932318 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.932318 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.932584 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.932584 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.932805 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.932926 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.933040 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.933168 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.933300 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.933300 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.933570 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.933701 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.933846 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.933989 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.934130 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.934262 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.934403 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.934535 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.934675 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.934675 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.934900 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.935038 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.935286 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.935424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.935549 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.935689 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.935837 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.935837 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.935837 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.936376 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.936528 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.936662 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.936801 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.936933 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.937072 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.937220 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.937355 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.937565 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.937679 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.937790 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.937934 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.938066 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.938187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.938299 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.938454 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.938454 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.938731 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.938731 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.939007 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.939852 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.939995 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.939995 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.940228 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.940376 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.940509 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.940640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.940770 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.940901 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.941043 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.941043 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.941269 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.941400 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.941551 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.941692 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.941912 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.942041 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.942172 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.942172 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.942419 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.942551 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.942694 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.942829 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.942949 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.943059 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.943170 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.943308 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.943448 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.943590 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.943723 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.943861 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.943994 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.944141 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.944281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.944404 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.945089 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.945452 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.945693 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.945843 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.945985 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.946126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.946266 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.946398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.946538 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.946682 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.946811 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.946925 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.947048 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.947187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.947327 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.947469 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.947609 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.947743 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.947882 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.948015 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.948138 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.948251 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.948363 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.948474 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.948586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.948704 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.948828 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.948828 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.949056 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.950508 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.950508 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.950749 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.950872 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.950872 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.951134 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.951267 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.951267 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.951784 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.951784 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.951784 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.951784 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.951784 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.951784 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.952438 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.952581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.952713 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.952713 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.952986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.953126 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.953126 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.953403 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.953553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.953553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.953553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.953935 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.954079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.954079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.954335 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.954476 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.954476 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.954734 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.954865 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.955000 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.955124 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.955124 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.955124 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.955497 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.955630 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.955630 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.956003 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.956139 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.956139 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.956403 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.956536 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.956678 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.956841 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.956968 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.957099 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.957099 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.957099 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.957099 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.957099 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.957788 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.957927 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.957927 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.957927 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.958304 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.958443 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.958443 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.958709 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.958848 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.958848 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.958848 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.959239 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.959378 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.959378 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.961011 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.961160 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.961294 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.961478 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.961618 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.961755 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.961895 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.962036 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.962036 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.962036 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.962036 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.962563 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.962702 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.962702 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.962978 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.963253 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.963410 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.963575 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.963721 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.963853 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.963983 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.964121 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.964253 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 09:47:07.964382 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.964382 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.964382 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.964382 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.964382 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.964382 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.964382 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.964382 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.965344 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.965344 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.965344 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.965344 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.965344 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.965344 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.965344 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.965344 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.966908 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.966908 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.966908 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.966908 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.966908 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.966908 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.966908 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.967744 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.967744 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.967744 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.967744 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.967744 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.967744 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.967744 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.967744 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.968740 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.968740 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.968740 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.968740 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.968740 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.968740 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.968740 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.968740 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.970969 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.970969 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.970969 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.970969 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.970969 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.970969 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.970969 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.970969 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.971909 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.971909 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.971909 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.971909 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.971909 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.971909 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.971909 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.971909 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.972753 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.972753 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.972753 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.972753 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.972753 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.973279 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.973279 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.973533 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.973802 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.974140 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.974466 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.974769 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.975090 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.975411 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.976464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.978171 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.978480 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.978815 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.979144 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.979475 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.979850 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.980365 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.980525 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.980759 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.981093 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.981356 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.981702 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.982017 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.982329 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.982645 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.982958 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.983277 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.983588 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.983906 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.984223 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.984607 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.984846 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.985161 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.985552 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.985886 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.986200 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.986537 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.986835 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.987152 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.987481 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.987798 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.988114 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.988473 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.988797 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.989353 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.989714 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.990043 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.990488 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.990708 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.991023 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.991356 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.992772 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.993113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.993498 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.993786 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.994105 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.994430 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.994749 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.995157 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.995379 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.995696 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.996012 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.996439 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.996637 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.996952 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.997266 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.997625 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.997911 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.998259 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.998583 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.998905 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.999225 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.999546 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:07.999861 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.000178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.000665 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.000829 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.001155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.001442 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.001749 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.002056 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.002488 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.002807 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.003127 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.003451 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.004024 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.004355 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.004679 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.004995 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.005320 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.005660 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.005993 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.006342 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.006784 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.007022 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.007915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.008238 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.008554 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.008873 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.009200 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.009542 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.009856 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.010241 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.010709 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.010886 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.011227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.011404 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.011688 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.012002 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.012309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.012616 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.012925 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.013232 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.013565 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.013875 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.014190 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.014501 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.014809 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.015116 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.015423 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.015728 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.016062 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.016400 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.016720 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.017048 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.017363 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.017722 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.018035 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.018359 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.018685 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.019008 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.019322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.019659 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.019975 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.020358 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.020816 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.020981 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.021213 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.021550 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.021882 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.022210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.022520 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.023353 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.023528 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO dbcounter [None req-b9d1caf8-9174-42bd-9d39-27020145c523 None None] Registered counter for database nova_api Aug 31 09:47:08.023682 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.024013 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.024345 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.024668 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.025006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.025325 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.025671 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.025989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.026305 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.026624 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.026954 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.027267 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.027583 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.027907 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.028228 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.028566 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.028897 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.029215 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.029579 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.029915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.030270 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.030592 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.030946 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.031276 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.031599 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.031919 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.032219 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:08.032465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 09:47:08.044428 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_db.sqlalchemy.engines [None req-b9d1caf8-9174-42bd-9d39-27020145c523 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:47:08.051311 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writer thread running {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:47:08.097689 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO dbcounter [None req-8104a743-1f0c-4eb0-a57b-07b74eed819a None None] Registered counter for database nova_api Aug 31 09:47:08.108693 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.context [None req-b9d1caf8-9174-42bd-9d39-27020145c523 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),28536b87-4849-4a8b-a399-9479669b101c(cell1) {{(pid=127171) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 09:47:08.112718 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b9d1caf8-9174-42bd-9d39-27020145c523 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:08.113189 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b9d1caf8-9174-42bd-9d39-27020145c523 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:08.114786 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b9d1caf8-9174-42bd-9d39-27020145c523 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:08.115511 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b9d1caf8-9174-42bd-9d39-27020145c523 None None] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:08.115957 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b9d1caf8-9174-42bd-9d39-27020145c523 None None] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:08.118620 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b9d1caf8-9174-42bd-9d39-27020145c523 None None] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:08.119948 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_db.sqlalchemy.engines [None req-8104a743-1f0c-4eb0-a57b-07b74eed819a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:47:08.120765 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO dbcounter [None req-b9d1caf8-9174-42bd-9d39-27020145c523 None None] Registered counter for database nova_cell0 Aug 31 09:47:08.125274 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO dbcounter [None req-b9d1caf8-9174-42bd-9d39-27020145c523 None None] Registered counter for database nova_cell1 Aug 31 09:47:08.126752 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writer thread running {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:47:08.132962 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_db.sqlalchemy.engines [None req-b9d1caf8-9174-42bd-9d39-27020145c523 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:47:08.134868 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_db.sqlalchemy.engines [None req-b9d1caf8-9174-42bd-9d39-27020145c523 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:47:08.140996 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writer thread running {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:47:08.142406 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writer thread running {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:47:08.183992 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.context [None req-8104a743-1f0c-4eb0-a57b-07b74eed819a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),28536b87-4849-4a8b-a399-9479669b101c(cell1) {{(pid=127170) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 09:47:08.188059 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8104a743-1f0c-4eb0-a57b-07b74eed819a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:08.188530 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8104a743-1f0c-4eb0-a57b-07b74eed819a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:08.190119 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8104a743-1f0c-4eb0-a57b-07b74eed819a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:08.190837 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8104a743-1f0c-4eb0-a57b-07b74eed819a None None] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:08.191278 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8104a743-1f0c-4eb0-a57b-07b74eed819a None None] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:08.193229 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8104a743-1f0c-4eb0-a57b-07b74eed819a None None] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:08.195442 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO dbcounter [None req-8104a743-1f0c-4eb0-a57b-07b74eed819a None None] Registered counter for database nova_cell0 Aug 31 09:47:08.199562 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO dbcounter [None req-8104a743-1f0c-4eb0-a57b-07b74eed819a None None] Registered counter for database nova_cell1 Aug 31 09:47:08.206973 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_db.sqlalchemy.engines [None req-8104a743-1f0c-4eb0-a57b-07b74eed819a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:47:08.208641 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_db.sqlalchemy.engines [None req-8104a743-1f0c-4eb0-a57b-07b74eed819a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:47:08.214878 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writer thread running {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:47:08.217581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writer thread running {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:47:08.298195 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO dbcounter [None req-b9d1caf8-9174-42bd-9d39-27020145c523 None None] Registered counter for database nova_cell0 Aug 31 09:47:08.305498 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_db.sqlalchemy.engines [None req-b9d1caf8-9174-42bd-9d39-27020145c523 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:47:08.310416 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writer thread running {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:47:08.365605 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO dbcounter [None req-8104a743-1f0c-4eb0-a57b-07b74eed819a None None] Registered counter for database nova_cell0 Aug 31 09:47:08.372655 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_db.sqlalchemy.engines [None req-8104a743-1f0c-4eb0-a57b-07b74eed819a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:47:08.377076 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writer thread running {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:47:08.642559 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: WARNING keystonemiddleware.auth_token [None req-b9d1caf8-9174-42bd-9d39-27020145c523 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 09:47:08.650882 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: WARNING keystonemiddleware.auth_token [None req-b9d1caf8-9174-42bd-9d39-27020145c523 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 09:47:08.703105 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: WARNING keystonemiddleware.auth_token [None req-8104a743-1f0c-4eb0-a57b-07b74eed819a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 09:47:08.711099 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: WARNING keystonemiddleware.auth_token [None req-8104a743-1f0c-4eb0-a57b-07b74eed819a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 09:47:09.005066 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: WARNING keystonemiddleware.auth_token [None req-b9d1caf8-9174-42bd-9d39-27020145c523 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 09:47:09.012125 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: WARNING keystonemiddleware.auth_token [None req-b9d1caf8-9174-42bd-9d39-27020145c523 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 09:47:09.017703 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556e2a2789c0 pid: 127171 (default app) Aug 31 09:47:09.069104 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: WARNING keystonemiddleware.auth_token [None req-8104a743-1f0c-4eb0-a57b-07b74eed819a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 09:47:09.076177 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: WARNING keystonemiddleware.auth_token [None req-8104a743-1f0c-4eb0-a57b-07b74eed819a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 09:47:09.081613 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556e2a2789c0 pid: 127170 (default app) Aug 31 09:47:44.841662 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=3 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:44.843000 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=3 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:44.843893 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=3 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:44.844877 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=3 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:45.981910 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-49113975-908b-48c5-9afb-ee6acb66e71a tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] Action: 'create', calling method: .version_select at 0x7f5508e43e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-34244030", "metadata": {"Type": "work"}}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:47:45.991602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-49113975-908b-48c5-9afb-ee6acb66e71a tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] Request method failure captured: Aug 31 09:47:45.991602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 09:47:45.991602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept: application/json Aug 31 09:47:45.991602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept-Encoding: identity Aug 31 09:47:45.991602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Connection: close Aug 31 09:47:45.991602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Length: 120 Aug 31 09:47:45.991602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Type: application/json Aug 31 09:47:45.991602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Host: 10.222.0.13 Aug 31 09:47:45.991602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Openstack-System-Scope: None Aug 31 09:47:45.991602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: User-Agent: python-urllib3/1.26.12 Aug 31 09:47:45.991602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Auth-Token: gAAAAABjDy5AAwhlt7pToggssLcCWuIk1vzmvRgmPG6QTXb0Bp6fQ5EA9OH0hINPwW7FlhztbTOWGtDoUxX6QEUPVg6n774NmTwEsH4oFX7mXGI_WaNZfEAtZSwQS0W9Gzm3PeF5d_4dk_5kxaNSOYNqOd5vKOUhJjIRuV2IOhrfKbwj6ajIDAM Aug 31 09:47:45.991602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Id: None Aug 31 09:47:45.991602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Name: None Aug 31 09:47:45.991602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Identity-Status: Confirmed Aug 31 09:47:45.991602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Is-Admin-Project: True Aug 31 09:47:45.991602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Id: default Aug 31 09:47:45.991602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Name: Default Aug 31 09:47:45.991602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Id: 1073c2fa1d8a4810a4846b7ccd823a19 Aug 31 09:47:45.991602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Name: tempest-VolumesNegativeTest-1837542519 Aug 31 09:47:45.991602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Role: member,reader Aug 31 09:47:45.991602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Roles: member,reader Aug 31 09:47:45.992912 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1073c2fa1d8a4810a4846b7ccd823a19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1073c2fa1d8a4810a4846b7ccd823a19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1073c2fa1d8a4810a4846b7ccd823a19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1073c2fa1d8a4810a4846b7ccd823a19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:47:45.992912 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant: tempest-VolumesNegativeTest-1837542519 Aug 31 09:47:45.992912 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Id: 1073c2fa1d8a4810a4846b7ccd823a19 Aug 31 09:47:45.992912 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Name: tempest-VolumesNegativeTest-1837542519 Aug 31 09:47:45.992912 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User: tempest-VolumesNegativeTest-1837542519-project Aug 31 09:47:45.992912 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Id: default Aug 31 09:47:45.992912 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Name: Default Aug 31 09:47:45.992912 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Id: bf41ca204722491abce3c27f2ff87126 Aug 31 09:47:45.992912 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Name: tempest-VolumesNegativeTest-1837542519-project Aug 31 09:47:45.992912 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Aug 31 09:47:45.992912 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-34244030", "metadata": {"Type": "work"}}} Aug 31 09:47:45.992912 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: method: Aug 31 09:47:45.992912 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 09:47:45.994322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-34244030', 'metadata': {'Type': 'work'}}}} Aug 31 09:47:45.994322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:47:45.994322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:47:45.994322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 09:47:45.994322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 09:47:45.994322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 09:47:45.994322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise error Aug 31 09:47:45.994322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 31 09:47:45.994322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:47:45.994322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 09:47:45.994322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 09:47:45.994322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:47:45.994322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 09:47:45.994322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi '#$%' Aug 31 09:47:45.994322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:47:45.994322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:47:45.994322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:47:45.994322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:47:45.994322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:47:45.994322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:47:45.994322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:47:45.994322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:47:45.997187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:47:45.997187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:47:45.997187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:47:45.997187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:47:45.997187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 09:47:45.997187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 09:47:45.997187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 09:47:45.997187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 09:47:45.997187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 09:47:45.997187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 09:47:45.997187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 09:47:45.997187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:47:45.997187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:47:45.997187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:47:45.997187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:47:45.997187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:47:45.997187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:47:45.997187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 09:47:45.997187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 09:47:45.999787 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 09:47:45.999787 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:47:45.999787 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-49113975-908b-48c5-9afb-ee6acb66e71a tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:47:45.999787 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-49113975-908b-48c5-9afb-ee6acb66e71a tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.164274 Aug 31 09:47:45.999787 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 1/1] 10.222.0.13 () {60 vars in 1156 bytes} [Wed Aug 31 09:47:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1166 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 09:47:46.005075 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=3 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:46.006754 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=3 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:46.007559 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=3 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:46.008513 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=3 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:46.235891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-aff29e45-4594-420e-923c-4008cf22f007 tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] Action: 'create', calling method: .version_select at 0x7f5508e3b940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1145115715", "metadata": {"Type": "work"}}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:47:46.242326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-aff29e45-4594-420e-923c-4008cf22f007 tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] Request method failure captured: Aug 31 09:47:46.242326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 09:47:46.242326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 09:47:46.242326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 09:47:46.242326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 09:47:46.242326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 120 Aug 31 09:47:46.242326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 09:47:46.242326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 09:47:46.242326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 09:47:46.242326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 09:47:46.242326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy5AAwhlt7pToggssLcCWuIk1vzmvRgmPG6QTXb0Bp6fQ5EA9OH0hINPwW7FlhztbTOWGtDoUxX6QEUPVg6n774NmTwEsH4oFX7mXGI_WaNZfEAtZSwQS0W9Gzm3PeF5d_4dk_5kxaNSOYNqOd5vKOUhJjIRuV2IOhrfKbwj6ajIDAM Aug 31 09:47:46.242326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 09:47:46.242326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 09:47:46.242326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 09:47:46.242326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 09:47:46.242326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 09:47:46.242326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 09:47:46.242326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: 1073c2fa1d8a4810a4846b7ccd823a19 Aug 31 09:47:46.242326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-VolumesNegativeTest-1837542519 Aug 31 09:47:46.242326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 09:47:46.242326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 09:47:46.243877 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1073c2fa1d8a4810a4846b7ccd823a19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1073c2fa1d8a4810a4846b7ccd823a19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1073c2fa1d8a4810a4846b7ccd823a19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1073c2fa1d8a4810a4846b7ccd823a19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:47:46.243877 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-VolumesNegativeTest-1837542519 Aug 31 09:47:46.243877 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: 1073c2fa1d8a4810a4846b7ccd823a19 Aug 31 09:47:46.243877 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-VolumesNegativeTest-1837542519 Aug 31 09:47:46.243877 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-VolumesNegativeTest-1837542519-project Aug 31 09:47:46.243877 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 09:47:46.243877 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 09:47:46.243877 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: bf41ca204722491abce3c27f2ff87126 Aug 31 09:47:46.243877 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-VolumesNegativeTest-1837542519-project Aug 31 09:47:46.243877 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Aug 31 09:47:46.243877 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1145115715", "metadata": {"Type": "work"}}} Aug 31 09:47:46.243877 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: Aug 31 09:47:46.243877 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 09:47:46.244779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1145115715', 'metadata': {'Type': 'work'}}}} Aug 31 09:47:46.244779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:47:46.244779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:47:46.244779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 09:47:46.244779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 09:47:46.244779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 09:47:46.244779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise error Aug 31 09:47:46.244779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 09:47:46.244779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:46.244779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 31 09:47:46.244779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 09:47:46.244779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:46.244779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 09:47:46.244779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi '0' Aug 31 09:47:46.244779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:46.244779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:47:46.244779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:46.244779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:47:46.244779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:47:46.244779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:47:46.244779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:47:46.244779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:47:46.246774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:47:46.246774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:47:46.246774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:47:46.246774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:47:46.246774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 09:47:46.246774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 09:47:46.246774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 09:47:46.246774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 09:47:46.246774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 09:47:46.246774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 09:47:46.246774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 09:47:46.246774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:46.246774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:47:46.246774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:46.246774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:47:46.246774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:47:46.246774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:47:46.246774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 09:47:46.246774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 09:47:46.250036 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 09:47:46.250036 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:46.250036 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-aff29e45-4594-420e-923c-4008cf22f007 tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:47:46.250036 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-aff29e45-4594-420e-923c-4008cf22f007 tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.244452 Aug 31 09:47:46.250036 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 1/2] 10.222.0.13 () {60 vars in 1156 bytes} [Wed Aug 31 09:47:45 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 251 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 09:47:46.256243 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a4df5427-6bfe-4dc9-a4c5-8c4430f2c496 tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] Action: 'create', calling method: .version_select at 0x7f5508e3b940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-19407058", "metadata": {"Type": "work"}}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:47:46.259891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a4df5427-6bfe-4dc9-a4c5-8c4430f2c496 tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] Request method failure captured: Aug 31 09:47:46.259891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 09:47:46.259891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 09:47:46.259891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 09:47:46.259891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 09:47:46.259891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 117 Aug 31 09:47:46.259891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 09:47:46.259891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 09:47:46.259891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 09:47:46.259891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 09:47:46.259891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy5AAwhlt7pToggssLcCWuIk1vzmvRgmPG6QTXb0Bp6fQ5EA9OH0hINPwW7FlhztbTOWGtDoUxX6QEUPVg6n774NmTwEsH4oFX7mXGI_WaNZfEAtZSwQS0W9Gzm3PeF5d_4dk_5kxaNSOYNqOd5vKOUhJjIRuV2IOhrfKbwj6ajIDAM Aug 31 09:47:46.259891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 09:47:46.259891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 09:47:46.259891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 09:47:46.259891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 09:47:46.259891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 09:47:46.259891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 09:47:46.259891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: 1073c2fa1d8a4810a4846b7ccd823a19 Aug 31 09:47:46.259891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-VolumesNegativeTest-1837542519 Aug 31 09:47:46.259891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 09:47:46.259891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 09:47:46.261467 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1073c2fa1d8a4810a4846b7ccd823a19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1073c2fa1d8a4810a4846b7ccd823a19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1073c2fa1d8a4810a4846b7ccd823a19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1073c2fa1d8a4810a4846b7ccd823a19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:47:46.261467 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-VolumesNegativeTest-1837542519 Aug 31 09:47:46.261467 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: 1073c2fa1d8a4810a4846b7ccd823a19 Aug 31 09:47:46.261467 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-VolumesNegativeTest-1837542519 Aug 31 09:47:46.261467 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-VolumesNegativeTest-1837542519-project Aug 31 09:47:46.261467 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 09:47:46.261467 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 09:47:46.261467 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: bf41ca204722491abce3c27f2ff87126 Aug 31 09:47:46.261467 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-VolumesNegativeTest-1837542519-project Aug 31 09:47:46.261467 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Aug 31 09:47:46.261467 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-19407058", "metadata": {"Type": "work"}}} Aug 31 09:47:46.261467 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: Aug 31 09:47:46.261467 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 09:47:46.262302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-19407058', 'metadata': {'Type': 'work'}}}} Aug 31 09:47:46.262302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:47:46.262302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:47:46.262302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 09:47:46.262302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 09:47:46.262302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 09:47:46.262302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise error Aug 31 09:47:46.262302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 31 09:47:46.262302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:46.262302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 09:47:46.262302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 09:47:46.262302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:46.262302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 09:47:46.262302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi '' Aug 31 09:47:46.262302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:46.262302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:47:46.262302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:46.262302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:47:46.262302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:47:46.262302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:47:46.262302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:47:46.262302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:47:46.263640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:47:46.263640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:47:46.263640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:47:46.263640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:47:46.263640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 09:47:46.263640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 09:47:46.263640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 09:47:46.263640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 09:47:46.263640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 09:47:46.263640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 09:47:46.263640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 09:47:46.263640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:46.263640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:47:46.263640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:46.263640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:47:46.263640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:47:46.263640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:47:46.263640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 09:47:46.263640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 09:47:46.265765 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 09:47:46.265765 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:46.265765 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a4df5427-6bfe-4dc9-a4c5-8c4430f2c496 tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:47:46.265765 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a4df5427-6bfe-4dc9-a4c5-8c4430f2c496 tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010853 Aug 31 09:47:46.265765 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 2/3] 10.222.0.13 () {60 vars in 1156 bytes} [Wed Aug 31 09:47:46 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 09:47:46.275172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-610629f3-960a-492b-8e3c-992ee5a57f59 tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] Calling method '.version_select at 0x7f5508cf83a0>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:46.600101 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-efb2cf00-84ea-4d0f-bcde-5d347444ffa2 tempest-VolumesGetTestJSON-458412212 tempest-VolumesGetTestJSON-458412212-project] Action: 'create', calling method: .version_select at 0x7f5508d39940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-756077998", "metadata": {"Type": "work"}}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:47:47.875230 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-610629f3-960a-492b-8e3c-992ee5a57f59 tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] HTTP exception thrown: Volume tempest-invalid-890056546 could not be found. Aug 31 09:47:47.879366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-610629f3-960a-492b-8e3c-992ee5a57f59 tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] Request method failure captured: Aug 31 09:47:47.879366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-890056546 HTTP/1.1 Aug 31 09:47:47.879366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 09:47:47.879366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 09:47:47.879366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 09:47:47.879366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 09:47:47.879366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 09:47:47.879366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 09:47:47.879366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 09:47:47.879366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 09:47:47.879366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy5AAwhlt7pToggssLcCWuIk1vzmvRgmPG6QTXb0Bp6fQ5EA9OH0hINPwW7FlhztbTOWGtDoUxX6QEUPVg6n774NmTwEsH4oFX7mXGI_WaNZfEAtZSwQS0W9Gzm3PeF5d_4dk_5kxaNSOYNqOd5vKOUhJjIRuV2IOhrfKbwj6ajIDAM Aug 31 09:47:47.879366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 09:47:47.879366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 09:47:47.879366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 09:47:47.879366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 09:47:47.879366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 09:47:47.879366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 09:47:47.879366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: 1073c2fa1d8a4810a4846b7ccd823a19 Aug 31 09:47:47.879366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-VolumesNegativeTest-1837542519 Aug 31 09:47:47.879366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 09:47:47.879366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 09:47:47.880682 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1073c2fa1d8a4810a4846b7ccd823a19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1073c2fa1d8a4810a4846b7ccd823a19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1073c2fa1d8a4810a4846b7ccd823a19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1073c2fa1d8a4810a4846b7ccd823a19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:47:47.880682 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-VolumesNegativeTest-1837542519 Aug 31 09:47:47.880682 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: 1073c2fa1d8a4810a4846b7ccd823a19 Aug 31 09:47:47.880682 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-VolumesNegativeTest-1837542519 Aug 31 09:47:47.880682 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-VolumesNegativeTest-1837542519-project Aug 31 09:47:47.880682 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 09:47:47.880682 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 09:47:47.880682 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: bf41ca204722491abce3c27f2ff87126 Aug 31 09:47:47.880682 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-VolumesNegativeTest-1837542519-project Aug 31 09:47:47.880682 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: Aug 31 09:47:47.880682 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Volume tempest-invalid-890056546 could not be found. Aug 31 09:47:47.880682 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': 'tempest-invalid-890056546'} Aug 31 09:47:47.880682 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:47:47.882158 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:47:47.882158 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:47:47.882158 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:47:47.882158 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 09:47:47.882158 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 09:47:47.882158 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 09:47:47.882158 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 09:47:47.882158 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 09:47:47.882158 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 09:47:47.882158 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 09:47:47.882158 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 09:47:47.882158 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:47:47.882158 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:47:47.882158 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:47:47.882158 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:47:47.882158 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-890056546 could not be found. (HTTP 404) (Request-ID: req-eca7f3a3-9a58-4815-a83a-9612e02c7da9) Aug 31 09:47:47.882158 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:47.882158 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:47:47.882158 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:47.883274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:47:47.883274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 09:47:47.883274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 09:47:47.883274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 09:47:47.883274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 09:47:47.883274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 09:47:47.883274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 09:47:47.883274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 09:47:47.883274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 09:47:47.883274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:47:47.883274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:47:47.883274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 09:47:47.883274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 09:47:47.883274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 09:47:47.883274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 09:47:47.883274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 09:47:47.883274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 09:47:47.883274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 09:47:47.883274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 09:47:47.884643 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:47:47.884643 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:47:47.884643 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:47:47.884643 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:47:47.884643 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-890056546 could not be found. Aug 31 09:47:47.884643 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:47.884643 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:47:47.884643 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:47.884643 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:47:47.884643 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:47:47.884643 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:47:47.884643 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:47:47.884643 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:47:47.884643 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:47:47.884643 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:47:47.884643 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:47:47.884643 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:47:47.884643 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 09:47:47.884643 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:47:47.884643 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-890056546 could not be found. Aug 31 09:47:47.885821 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:47.885821 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:47:47.885821 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:47.885821 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:47:47.885821 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:47:47.885821 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:47:47.885821 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:47:47.885821 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:47:47.885821 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-890056546 could not be found. Aug 31 09:47:47.885821 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:47.888481 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-610629f3-960a-492b-8e3c-992ee5a57f59 tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] Returning 404 to user: Volume tempest-invalid-890056546 could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:47:47.890337 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-610629f3-960a-492b-8e3c-992ee5a57f59 tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-890056546" status: 404 len: 98 microversion: 2.1 time: 1.621090 Aug 31 09:47:47.895986 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 3/4] 10.222.0.13 () {58 vars in 1215 bytes} [Wed Aug 31 09:47:46 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-890056546 => generated 98 bytes in 1628 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 09:47:48.378143 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-6ad4c894-26b5-43fa-85ed-5ac1cae65118 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Action: 'create', calling method: .version_select at 0x7f5508c4a790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1161631728"}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:47:49.456100 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-efb2cf00-84ea-4d0f-bcde-5d347444ffa2 tempest-VolumesGetTestJSON-458412212 tempest-VolumesGetTestJSON-458412212-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.335787 Aug 31 09:47:49.456773 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 2/5] 10.222.0.13 () {60 vars in 1156 bytes} [Wed Aug 31 09:47:46 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3338 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 31 09:47:49.462527 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-b23cdb7c-1dda-4418-88dd-8d348d5c731c tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004499 Aug 31 09:47:49.469797 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 3/6] 10.222.0.13 () {58 vars in 1140 bytes} [Wed Aug 31 09:47:49 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 09:47:49.475273 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c4405f3f-a187-46c5-b72d-4959b3a0ec14 tempest-VolumesGetTestJSON-458412212 tempest-VolumesGetTestJSON-458412212-project] Calling method '.version_select at 0x7f5508c97550>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:49.512573 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-6ad4c894-26b5-43fa-85ed-5ac1cae65118 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.614062 Aug 31 09:47:49.513400 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 4/7] 10.222.0.13 () {60 vars in 1155 bytes} [Wed Aug 31 09:47:47 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1616 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 09:47:49.518891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-4a39d048-a977-4c98-b282-c08d8d71008a tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004168 Aug 31 09:47:49.520070 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 5/8] 10.222.0.13 () {58 vars in 1137 bytes} [Wed Aug 31 09:47:49 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 09:47:49.535731 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-26372c55-1f99-464a-a851-7b27161cd3ce tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] Calling method '.version_select at 0x7f5508c4a940>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:49.639455 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c4405f3f-a187-46c5-b72d-4959b3a0ec14 tempest-VolumesGetTestJSON-458412212 tempest-VolumesGetTestJSON-458412212-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/6e1a460e-3b90-4987-88c7-26c937b27bc3" status: 200 len: 352 microversion: 2.1 time: 0.168417 Aug 31 09:47:49.640105 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 4/9] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 31 09:47:49 2022] GET /compute/v2.1/os-volumes/6e1a460e-3b90-4987-88c7-26c937b27bc3 => generated 352 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:47:49.656884 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-a13bdc38-478f-4f93-a468-be6a26d6d885 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Calling method '.version_select at 0x7f5508c97c10>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:49.677872 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-26372c55-1f99-464a-a851-7b27161cd3ce tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] HTTP exception thrown: Volume 3273e86a-e853-415e-b187-4cc1739ce5d3 could not be found. Aug 31 09:47:49.680321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-26372c55-1f99-464a-a851-7b27161cd3ce tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] Request method failure captured: Aug 31 09:47:49.680321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: DELETE /compute/v2.1/os-volumes/3273e86a-e853-415e-b187-4cc1739ce5d3 HTTP/1.1 Aug 31 09:47:49.680321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 09:47:49.680321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 09:47:49.680321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 09:47:49.680321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 09:47:49.680321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 09:47:49.680321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 09:47:49.680321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 09:47:49.680321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 09:47:49.680321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy5AAwhlt7pToggssLcCWuIk1vzmvRgmPG6QTXb0Bp6fQ5EA9OH0hINPwW7FlhztbTOWGtDoUxX6QEUPVg6n774NmTwEsH4oFX7mXGI_WaNZfEAtZSwQS0W9Gzm3PeF5d_4dk_5kxaNSOYNqOd5vKOUhJjIRuV2IOhrfKbwj6ajIDAM Aug 31 09:47:49.680321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 09:47:49.680321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 09:47:49.680321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 09:47:49.680321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 09:47:49.680321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 09:47:49.680321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 09:47:49.680321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: 1073c2fa1d8a4810a4846b7ccd823a19 Aug 31 09:47:49.680321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-VolumesNegativeTest-1837542519 Aug 31 09:47:49.680321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 09:47:49.680321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 09:47:49.681738 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1073c2fa1d8a4810a4846b7ccd823a19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1073c2fa1d8a4810a4846b7ccd823a19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1073c2fa1d8a4810a4846b7ccd823a19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1073c2fa1d8a4810a4846b7ccd823a19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:47:49.681738 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-VolumesNegativeTest-1837542519 Aug 31 09:47:49.681738 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: 1073c2fa1d8a4810a4846b7ccd823a19 Aug 31 09:47:49.681738 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-VolumesNegativeTest-1837542519 Aug 31 09:47:49.681738 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-VolumesNegativeTest-1837542519-project Aug 31 09:47:49.681738 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 09:47:49.681738 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 09:47:49.681738 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: bf41ca204722491abce3c27f2ff87126 Aug 31 09:47:49.681738 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-VolumesNegativeTest-1837542519-project Aug 31 09:47:49.681738 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: Aug 31 09:47:49.681738 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Volume 3273e86a-e853-415e-b187-4cc1739ce5d3 could not be found. Aug 31 09:47:49.681738 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': '3273e86a-e853-415e-b187-4cc1739ce5d3'} Aug 31 09:47:49.681738 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:47:49.682510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:47:49.682510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:47:49.682510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:47:49.682510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 09:47:49.682510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 09:47:49.682510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 09:47:49.682510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 09:47:49.682510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 09:47:49.682510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 09:47:49.682510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 09:47:49.682510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 09:47:49.682510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:47:49.682510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:47:49.682510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:47:49.682510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:47:49.682510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3273e86a-e853-415e-b187-4cc1739ce5d3 could not be found. (HTTP 404) (Request-ID: req-f37b30f1-1883-4f2f-ad75-a525bcc00c97) Aug 31 09:47:49.682510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:49.682510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:47:49.682510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:49.683591 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:47:49.683591 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 09:47:49.683591 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 09:47:49.683591 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 09:47:49.683591 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 09:47:49.683591 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 09:47:49.683591 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 09:47:49.683591 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 09:47:49.683591 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 09:47:49.683591 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:47:49.683591 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:47:49.683591 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 09:47:49.683591 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 09:47:49.683591 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 09:47:49.683591 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 09:47:49.683591 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 09:47:49.683591 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 09:47:49.683591 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 09:47:49.683591 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 09:47:49.685553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:47:49.685553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:47:49.685553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:47:49.685553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:47:49.685553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3273e86a-e853-415e-b187-4cc1739ce5d3 could not be found. Aug 31 09:47:49.685553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:49.685553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:47:49.685553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:49.685553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:47:49.685553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:47:49.685553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:47:49.685553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:47:49.685553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:47:49.685553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:47:49.685553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:47:49.685553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:47:49.685553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:47:49.685553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 09:47:49.685553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:47:49.688077 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3273e86a-e853-415e-b187-4cc1739ce5d3 could not be found. Aug 31 09:47:49.688077 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:49.688077 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:47:49.688077 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:49.688077 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:47:49.688077 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:47:49.688077 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:47:49.688077 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:47:49.688077 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:47:49.688077 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3273e86a-e853-415e-b187-4cc1739ce5d3 could not be found. Aug 31 09:47:49.688077 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:49.688077 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-26372c55-1f99-464a-a851-7b27161cd3ce tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] Returning 404 to user: Volume 3273e86a-e853-415e-b187-4cc1739ce5d3 could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:47:49.688077 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-26372c55-1f99-464a-a851-7b27161cd3ce tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/3273e86a-e853-415e-b187-4cc1739ce5d3" status: 404 len: 109 microversion: 2.1 time: 0.160735 Aug 31 09:47:49.689618 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 6/10] 10.222.0.13 () {58 vars in 1248 bytes} [Wed Aug 31 09:47:49 2022] DELETE /compute/v2.1/os-volumes/3273e86a-e853-415e-b187-4cc1739ce5d3 => generated 109 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:47:49.699291 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-5495430b-08e7-4c80-9731-12d5ea15a379 tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] Calling method '.version_select at 0x7f5508c5b280>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:49.768727 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-a13bdc38-478f-4f93-a468-be6a26d6d885 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/4706a65c-c5a6-422a-a381-3c66895949d8" status: 200 len: 345 microversion: 2.1 time: 0.126804 Aug 31 09:47:49.769657 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 5/11] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 31 09:47:49 2022] GET /compute/v2.1/os-volumes/4706a65c-c5a6-422a-a381-3c66895949d8 => generated 345 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:47:49.792774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-5495430b-08e7-4c80-9731-12d5ea15a379 tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] HTTP exception thrown: Volume ff530abf-cc3e-41b1-8afa-6922590a7c4a could not be found. Aug 31 09:47:49.795649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-5495430b-08e7-4c80-9731-12d5ea15a379 tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] Request method failure captured: Aug 31 09:47:49.795649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: GET /compute/v2.1/os-volumes/ff530abf-cc3e-41b1-8afa-6922590a7c4a HTTP/1.1 Aug 31 09:47:49.795649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 09:47:49.795649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 09:47:49.795649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 09:47:49.795649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 09:47:49.795649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 09:47:49.795649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 09:47:49.795649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 09:47:49.795649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 09:47:49.795649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy5AAwhlt7pToggssLcCWuIk1vzmvRgmPG6QTXb0Bp6fQ5EA9OH0hINPwW7FlhztbTOWGtDoUxX6QEUPVg6n774NmTwEsH4oFX7mXGI_WaNZfEAtZSwQS0W9Gzm3PeF5d_4dk_5kxaNSOYNqOd5vKOUhJjIRuV2IOhrfKbwj6ajIDAM Aug 31 09:47:49.795649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 09:47:49.795649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 09:47:49.795649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 09:47:49.795649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 09:47:49.795649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 09:47:49.795649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 09:47:49.795649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: 1073c2fa1d8a4810a4846b7ccd823a19 Aug 31 09:47:49.795649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-VolumesNegativeTest-1837542519 Aug 31 09:47:49.795649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 09:47:49.795649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 09:47:49.796946 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1073c2fa1d8a4810a4846b7ccd823a19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1073c2fa1d8a4810a4846b7ccd823a19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1073c2fa1d8a4810a4846b7ccd823a19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1073c2fa1d8a4810a4846b7ccd823a19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:47:49.796946 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-VolumesNegativeTest-1837542519 Aug 31 09:47:49.796946 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: 1073c2fa1d8a4810a4846b7ccd823a19 Aug 31 09:47:49.796946 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-VolumesNegativeTest-1837542519 Aug 31 09:47:49.796946 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-VolumesNegativeTest-1837542519-project Aug 31 09:47:49.796946 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 09:47:49.796946 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 09:47:49.796946 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: bf41ca204722491abce3c27f2ff87126 Aug 31 09:47:49.796946 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-VolumesNegativeTest-1837542519-project Aug 31 09:47:49.796946 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: Aug 31 09:47:49.796946 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Volume ff530abf-cc3e-41b1-8afa-6922590a7c4a could not be found. Aug 31 09:47:49.796946 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': 'ff530abf-cc3e-41b1-8afa-6922590a7c4a'} Aug 31 09:47:49.796946 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:47:49.798951 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:47:49.798951 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:47:49.798951 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:47:49.798951 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 09:47:49.798951 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 09:47:49.798951 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 09:47:49.798951 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 09:47:49.798951 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:47:49.798951 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:47:49.798951 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:47:49.798951 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:47:49.798951 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:47:49.798951 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:47:49.798951 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:47:49.798951 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:47:49.798951 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ff530abf-cc3e-41b1-8afa-6922590a7c4a could not be found. (HTTP 404) (Request-ID: req-7336a5c6-c9e9-4f24-be46-eaf34208f8ec) Aug 31 09:47:49.798951 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:49.798951 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:47:49.798951 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:49.800046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:47:49.800046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 09:47:49.800046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 09:47:49.800046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 09:47:49.800046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 09:47:49.800046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 09:47:49.800046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 09:47:49.800046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 09:47:49.800046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 09:47:49.800046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:47:49.800046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:47:49.800046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 09:47:49.800046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 09:47:49.800046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 09:47:49.800046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 09:47:49.800046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:47:49.800046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:47:49.800046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:47:49.800046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:47:49.802995 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:47:49.802995 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:47:49.802995 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:47:49.802995 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:47:49.802995 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ff530abf-cc3e-41b1-8afa-6922590a7c4a could not be found. Aug 31 09:47:49.802995 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:49.802995 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:47:49.802995 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:49.802995 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:47:49.802995 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:47:49.802995 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:47:49.802995 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:47:49.802995 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:47:49.802995 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:47:49.802995 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:47:49.802995 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:47:49.802995 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:47:49.802995 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 09:47:49.802995 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:47:49.804068 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ff530abf-cc3e-41b1-8afa-6922590a7c4a could not be found. Aug 31 09:47:49.804068 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:49.804068 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:47:49.804068 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:49.804068 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:47:49.804068 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:47:49.804068 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:47:49.804068 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:47:49.804068 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:47:49.804068 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ff530abf-cc3e-41b1-8afa-6922590a7c4a could not be found. Aug 31 09:47:49.804068 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:47:49.804068 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-5495430b-08e7-4c80-9731-12d5ea15a379 tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] Returning 404 to user: Volume ff530abf-cc3e-41b1-8afa-6922590a7c4a could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:47:49.804068 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-5495430b-08e7-4c80-9731-12d5ea15a379 tempest-VolumesNegativeTest-1837542519 tempest-VolumesNegativeTest-1837542519-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ff530abf-cc3e-41b1-8afa-6922590a7c4a" status: 404 len: 109 microversion: 2.1 time: 0.102778 Aug 31 09:47:49.804068 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 7/12] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 31 09:47:49 2022] GET /compute/v2.1/os-volumes/ff530abf-cc3e-41b1-8afa-6922590a7c4a => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:47:50.654911 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-d3df8715-43fc-4ace-a7c7-af3dd6d0a2c4 tempest-VolumesGetTestJSON-458412212 tempest-VolumesGetTestJSON-458412212-project] Calling method '.version_select at 0x7f5508c97b80>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:50.793779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a9b086b8-f8c5-475b-974c-4570a02f0db3 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Calling method '.version_select at 0x7f5508c4a550>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:50.923016 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a9b086b8-f8c5-475b-974c-4570a02f0db3 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/4706a65c-c5a6-422a-a381-3c66895949d8" status: 200 len: 345 microversion: 2.1 time: 0.141696 Aug 31 09:47:50.933680 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 8/13] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 31 09:47:50 2022] GET /compute/v2.1/os-volumes/4706a65c-c5a6-422a-a381-3c66895949d8 => generated 345 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:47:51.035407 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-d3df8715-43fc-4ace-a7c7-af3dd6d0a2c4 tempest-VolumesGetTestJSON-458412212 tempest-VolumesGetTestJSON-458412212-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/6e1a460e-3b90-4987-88c7-26c937b27bc3" status: 200 len: 353 microversion: 2.1 time: 0.385449 Aug 31 09:47:51.038041 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 6/14] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 31 09:47:50 2022] GET /compute/v2.1/os-volumes/6e1a460e-3b90-4987-88c7-26c937b27bc3 => generated 353 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:47:51.066013 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-81ca0ccc-ff36-4c48-b33f-0199b4f73a44 tempest-VolumesGetTestJSON-458412212 tempest-VolumesGetTestJSON-458412212-project] Calling method '.version_select at 0x7f5508c5b550>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:51.164777 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-81ca0ccc-ff36-4c48-b33f-0199b4f73a44 tempest-VolumesGetTestJSON-458412212 tempest-VolumesGetTestJSON-458412212-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/6e1a460e-3b90-4987-88c7-26c937b27bc3" status: 200 len: 353 microversion: 2.1 time: 0.117701 Aug 31 09:47:51.178178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 9/15] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 31 09:47:51 2022] GET /compute/v2.1/os-volumes/6e1a460e-3b90-4987-88c7-26c937b27bc3 => generated 353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:47:51.185368 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-a3c8d84e-2582-4951-b06f-c575f65c4c08 tempest-VolumesGetTestJSON-458412212 tempest-VolumesGetTestJSON-458412212-project] Calling method '.version_select at 0x7f5508c974c0>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:51.343413 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-a3c8d84e-2582-4951-b06f-c575f65c4c08 tempest-VolumesGetTestJSON-458412212 tempest-VolumesGetTestJSON-458412212-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/6e1a460e-3b90-4987-88c7-26c937b27bc3" status: 202 len: 0 microversion: 2.1 time: 0.162600 Aug 31 09:47:51.346187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 7/16] 10.222.0.13 () {58 vars in 1248 bytes} [Wed Aug 31 09:47:51 2022] DELETE /compute/v2.1/os-volumes/6e1a460e-3b90-4987-88c7-26c937b27bc3 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:47:51.356123 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-edd192eb-7529-4774-91bc-117ca9f8e487 tempest-VolumesGetTestJSON-458412212 tempest-VolumesGetTestJSON-458412212-project] Calling method '.version_select at 0x7f5508c4aaf0>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:51.496255 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-edd192eb-7529-4774-91bc-117ca9f8e487 tempest-VolumesGetTestJSON-458412212 tempest-VolumesGetTestJSON-458412212-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/6e1a460e-3b90-4987-88c7-26c937b27bc3" status: 200 len: 352 microversion: 2.1 time: 0.144873 Aug 31 09:47:51.496978 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 10/17] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 31 09:47:51 2022] GET /compute/v2.1/os-volumes/6e1a460e-3b90-4987-88c7-26c937b27bc3 => generated 352 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:47:51.966847 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-7c9504d2-300f-403b-b968-90adbc0341b2 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Calling method '.version_select at 0x7f5508c9e160>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:52.220315 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-7c9504d2-300f-403b-b968-90adbc0341b2 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/4706a65c-c5a6-422a-a381-3c66895949d8" status: 200 len: 346 microversion: 2.1 time: 0.279246 Aug 31 09:47:52.221341 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 8/18] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 31 09:47:51 2022] GET /compute/v2.1/os-volumes/4706a65c-c5a6-422a-a381-3c66895949d8 => generated 346 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:47:52.241184 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-57a80044-6f2d-417c-b953-6d31c5b923f2 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Action: 'create', calling method: .version_select at 0x7f5508ccee50>, body: {"snapshot": {"volume_id": "4706a65c-c5a6-422a-a381-3c66895949d8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1403955121"}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:47:52.513307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-636b9b3a-ed2d-4e6e-ac2a-a0f39e61da21 tempest-VolumesGetTestJSON-458412212 tempest-VolumesGetTestJSON-458412212-project] Calling method '.version_select at 0x7f5508c97310>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:52.761473 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-57a80044-6f2d-417c-b953-6d31c5b923f2 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.526383 Aug 31 09:47:52.762429 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 11/19] 10.222.0.13 () {60 vars in 1162 bytes} [Wed Aug 31 09:47:52 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:47:52.774005 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-02032326-5f01-4d42-96c3-819cbfe62a40 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Calling method '.version_select at 0x7f5508c5bdc0>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:52.854192 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.wsgi [None req-636b9b3a-ed2d-4e6e-ac2a-a0f39e61da21 tempest-VolumesGetTestJSON-458412212 tempest-VolumesGetTestJSON-458412212-project] HTTP exception thrown: Volume 6e1a460e-3b90-4987-88c7-26c937b27bc3 could not be found. Aug 31 09:47:52.859581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-636b9b3a-ed2d-4e6e-ac2a-a0f39e61da21 tempest-VolumesGetTestJSON-458412212 tempest-VolumesGetTestJSON-458412212-project] Request method failure captured: Aug 31 09:47:52.859581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: request: GET /compute/v2.1/os-volumes/6e1a460e-3b90-4987-88c7-26c937b27bc3 HTTP/1.1 Aug 31 09:47:52.859581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept: application/json Aug 31 09:47:52.859581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept-Encoding: identity Aug 31 09:47:52.859581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Connection: close Aug 31 09:47:52.859581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Length: 0 Aug 31 09:47:52.859581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Type: application/json Aug 31 09:47:52.859581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Host: 10.222.0.13 Aug 31 09:47:52.859581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Openstack-System-Scope: None Aug 31 09:47:52.859581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: User-Agent: python-urllib3/1.26.12 Aug 31 09:47:52.859581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Auth-Token: gAAAAABjDy5CUYeALRtcB9mbHHExOcdCJW03DLLfT-TBOU6H6uvgNLdGdUaq_Oj2mONngPcnvL0axRmvzj-cqfHu2OV5u9J5S2rOany71DlH39BIYey2VhX10OgKVOjCO1n6ZYoKncvU0befkZ7VbB6i6vwQ-bw8dFVVSM_X3nY2Ia5zxBg5lwI Aug 31 09:47:52.859581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Id: None Aug 31 09:47:52.859581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Name: None Aug 31 09:47:52.859581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Identity-Status: Confirmed Aug 31 09:47:52.859581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Is-Admin-Project: True Aug 31 09:47:52.859581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Id: default Aug 31 09:47:52.859581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Name: Default Aug 31 09:47:52.859581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Id: 05357b8aa9c6411e849aab8e271b1ca1 Aug 31 09:47:52.859581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Name: tempest-VolumesGetTestJSON-458412212 Aug 31 09:47:52.859581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Role: member,reader Aug 31 09:47:52.859581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Roles: member,reader Aug 31 09:47:52.860706 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/05357b8aa9c6411e849aab8e271b1ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/05357b8aa9c6411e849aab8e271b1ca1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/05357b8aa9c6411e849aab8e271b1ca1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_05357b8aa9c6411e849aab8e271b1ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:47:52.860706 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant: tempest-VolumesGetTestJSON-458412212 Aug 31 09:47:52.860706 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Id: 05357b8aa9c6411e849aab8e271b1ca1 Aug 31 09:47:52.860706 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Name: tempest-VolumesGetTestJSON-458412212 Aug 31 09:47:52.860706 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User: tempest-VolumesGetTestJSON-458412212-project Aug 31 09:47:52.860706 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Id: default Aug 31 09:47:52.860706 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Name: Default Aug 31 09:47:52.860706 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Id: 9bfb4fba581c45bbb1101be63a110025 Aug 31 09:47:52.860706 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Name: tempest-VolumesGetTestJSON-458412212-project Aug 31 09:47:52.860706 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: method: Aug 31 09:47:52.860706 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: exception: Volume 6e1a460e-3b90-4987-88c7-26c937b27bc3 could not be found. Aug 31 09:47:52.860706 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: action_args: {'id': '6e1a460e-3b90-4987-88c7-26c937b27bc3'} Aug 31 09:47:52.860706 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:47:52.861331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:47:52.861331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:47:52.861331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:47:52.861331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 09:47:52.861331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 09:47:52.861331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 09:47:52.861331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 09:47:52.861331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:47:52.861331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:47:52.861331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:47:52.861331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:47:52.861331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:47:52.861331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:47:52.861331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:47:52.861331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:47:52.861331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6e1a460e-3b90-4987-88c7-26c937b27bc3 could not be found. (HTTP 404) (Request-ID: req-690b171c-f3a4-4c93-8b6e-f6a5bdef47a2) Aug 31 09:47:52.861331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:47:52.861331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:47:52.861331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:47:52.862287 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:47:52.862287 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 09:47:52.862287 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 09:47:52.862287 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 09:47:52.862287 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 09:47:52.862287 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 09:47:52.862287 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 09:47:52.862287 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 09:47:52.862287 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 09:47:52.862287 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:47:52.862287 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:47:52.862287 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 09:47:52.862287 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 09:47:52.862287 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 09:47:52.862287 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 09:47:52.862287 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:47:52.862287 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:47:52.862287 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:47:52.862287 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:47:52.863153 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:47:52.863153 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:47:52.863153 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:47:52.863153 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:47:52.863153 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6e1a460e-3b90-4987-88c7-26c937b27bc3 could not be found. Aug 31 09:47:52.863153 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:47:52.863153 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:47:52.863153 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:47:52.863153 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:47:52.863153 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:47:52.863153 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:47:52.863153 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:47:52.863153 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:47:52.863153 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:47:52.863153 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:47:52.863153 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:47:52.863153 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:47:52.863153 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 09:47:52.863153 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:47:52.863969 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6e1a460e-3b90-4987-88c7-26c937b27bc3 could not be found. Aug 31 09:47:52.863969 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:47:52.863969 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:47:52.863969 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:47:52.863969 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:47:52.863969 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:47:52.863969 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:47:52.863969 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:47:52.863969 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:47:52.863969 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6e1a460e-3b90-4987-88c7-26c937b27bc3 could not be found. Aug 31 09:47:52.863969 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:47:52.863969 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-636b9b3a-ed2d-4e6e-ac2a-a0f39e61da21 tempest-VolumesGetTestJSON-458412212 tempest-VolumesGetTestJSON-458412212-project] Returning 404 to user: Volume 6e1a460e-3b90-4987-88c7-26c937b27bc3 could not be found. {{(pid=127171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:47:52.863969 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-636b9b3a-ed2d-4e6e-ac2a-a0f39e61da21 tempest-VolumesGetTestJSON-458412212 tempest-VolumesGetTestJSON-458412212-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/6e1a460e-3b90-4987-88c7-26c937b27bc3" status: 404 len: 109 microversion: 2.1 time: 0.355663 Aug 31 09:47:52.863969 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 9/20] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 31 09:47:52 2022] GET /compute/v2.1/os-volumes/6e1a460e-3b90-4987-88c7-26c937b27bc3 => generated 109 bytes in 357 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 09:47:53.018613 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-02032326-5f01-4d42-96c3-819cbfe62a40 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7" status: 200 len: 287 microversion: 2.1 time: 0.249680 Aug 31 09:47:53.019774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 12/21] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Aug 31 09:47:52 2022] GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7 => generated 287 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:47:53.038931 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-afea4dd4-cce2-4f88-b6ab-73068b44622b tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Calling method '.version_select at 0x7f5508d11160>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:53.149112 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-afea4dd4-cce2-4f88-b6ab-73068b44622b tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.121138 Aug 31 09:47:53.150115 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 10/22] 10.222.0.13 () {58 vars in 1140 bytes} [Wed Aug 31 09:47:53 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:47:53.161204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-0db0ce4c-d20b-434c-a942-48469964764d tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Calling method '.version_select at 0x7f5508c5b430>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:53.241897 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-0db0ce4c-d20b-434c-a942-48469964764d tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7" status: 200 len: 287 microversion: 2.1 time: 0.084688 Aug 31 09:47:53.248183 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 13/23] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Aug 31 09:47:53 2022] GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7 => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:47:54.257068 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-27325a04-a998-4355-9a69-bcdc3cc2bf8d tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Calling method '.version_select at 0x7f5508bf1550>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:54.354526 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-27325a04-a998-4355-9a69-bcdc3cc2bf8d tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7" status: 200 len: 287 microversion: 2.1 time: 0.103069 Aug 31 09:47:54.356316 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 11/24] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Aug 31 09:47:54 2022] GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7 => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:47:55.370296 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-c16a2cca-b73e-4c0a-818d-eff12018bded tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Calling method '.version_select at 0x7f5508c87040>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:55.419062 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-c16a2cca-b73e-4c0a-818d-eff12018bded tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7" status: 200 len: 287 microversion: 2.1 time: 0.053044 Aug 31 09:47:55.419867 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 14/25] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Aug 31 09:47:55 2022] GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:47:56.432890 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-e713b538-d9b1-4d2e-9cf3-2bfd16ad9f32 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Calling method '.version_select at 0x7f5508bf1ca0>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:56.567957 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-e713b538-d9b1-4d2e-9cf3-2bfd16ad9f32 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7" status: 200 len: 287 microversion: 2.1 time: 0.139809 Aug 31 09:47:56.569155 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 12/26] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Aug 31 09:47:56 2022] GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7 => generated 287 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:47:57.584830 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-c91aef83-08af-4f47-9af6-3e0b83132a5f tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Calling method '.version_select at 0x7f5508c4a1f0>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:57.697177 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-c91aef83-08af-4f47-9af6-3e0b83132a5f tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7" status: 200 len: 287 microversion: 2.1 time: 0.117641 Aug 31 09:47:57.698361 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 15/27] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Aug 31 09:47:57 2022] GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7 => generated 287 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:47:58.711055 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-2d235a71-9050-4153-8abb-e72873dd0a4e tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Calling method '.version_select at 0x7f5508c4a700>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:58.852100 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-2d235a71-9050-4153-8abb-e72873dd0a4e tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7" status: 200 len: 287 microversion: 2.1 time: 0.146003 Aug 31 09:47:58.852657 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 16/28] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Aug 31 09:47:58 2022] GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7 => generated 287 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:47:59.256285 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c41bd1a9-f508-42b8-b569-831055fda00f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1424446986", "imageRef": "8e078bb9-f274-4984-8128-d31407d49604", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:47:59.546505 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.network.neutron [None req-c41bd1a9-f508-42b8-b569-831055fda00f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] validate_networks() for [('2e69cc92-d348-4eef-9a4c-b8daacafc440', None, None, None, None, None)] {{(pid=127171) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:47:59.866008 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b4ea71ae-1ac3-4754-ac4f-1c10356d9dc2 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Calling method '.version_select at 0x7f5508c5ba60>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:47:59.934694 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b4ea71ae-1ac3-4754-ac4f-1c10356d9dc2 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7" status: 200 len: 287 microversion: 2.1 time: 0.073258 Aug 31 09:47:59.939939 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 17/29] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Aug 31 09:47:59 2022] GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7 => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:00.947699 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a2923db0-b110-4fe3-9308-f0d17feff9d6 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Calling method '.version_select at 0x7f5508c5b5e0>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:01.005641 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a2923db0-b110-4fe3-9308-f0d17feff9d6 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7" status: 200 len: 288 microversion: 2.1 time: 0.061279 Aug 31 09:48:01.012211 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 18/30] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Aug 31 09:48:00 2022] GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7 => generated 288 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:01.019447 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-2e7cf831-d3da-4627-b0a9-cb2b455c0fb4 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Calling method '.version_select at 0x7f5508c4ab80>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:01.197632 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-2e7cf831-d3da-4627-b0a9-cb2b455c0fb4 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7" status: 202 len: 0 microversion: 2.1 time: 0.183908 Aug 31 09:48:01.198436 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 19/31] 10.222.0.13 () {58 vars in 1254 bytes} [Wed Aug 31 09:48:01 2022] DELETE /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:48:01.212608 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-5630ffc3-2d84-4527-89ec-8680d962c3f0 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Calling method '.version_select at 0x7f5508c4aee0>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:01.291561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-5630ffc3-2d84-4527-89ec-8680d962c3f0 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7" status: 200 len: 287 microversion: 2.1 time: 0.087007 Aug 31 09:48:01.297242 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 20/32] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Aug 31 09:48:01 2022] GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7 => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:02.059788 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-c41bd1a9-f508-42b8-b569-831055fda00f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Flavor limits 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:48:02.060361 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-c41bd1a9-f508-42b8-b569-831055fda00f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Image limits 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:48:02.060997 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-c41bd1a9-f508-42b8-b569-831055fda00f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Flavor pref 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:48:02.061592 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-c41bd1a9-f508-42b8-b569-831055fda00f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Image pref 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:48:02.062134 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-c41bd1a9-f508-42b8-b569-831055fda00f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:48:02.099536 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c41bd1a9-f508-42b8-b569-831055fda00f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:02.100235 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c41bd1a9-f508-42b8-b569-831055fda00f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:02.102324 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c41bd1a9-f508-42b8-b569-831055fda00f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:02.103354 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c41bd1a9-f508-42b8-b569-831055fda00f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:02.105151 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c41bd1a9-f508-42b8-b569-831055fda00f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:02.107148 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c41bd1a9-f508-42b8-b569-831055fda00f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:02.153129 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-c41bd1a9-f508-42b8-b569-831055fda00f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Getting quotas for project c0fc6660b5494415915cdf2b325e5bd6. Resources: {'ram', 'instances', 'cores'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:48:02.164116 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-c41bd1a9-f508-42b8-b569-831055fda00f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Getting quotas for user 886e40cf192d46c2b2e7eb2a95ec62e1 and project c0fc6660b5494415915cdf2b325e5bd6. Resources: {'ram', 'instances', 'cores'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:48:02.180519 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c41bd1a9-f508-42b8-b569-831055fda00f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Going to run 1 instances... {{(pid=127171) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:48:02.184077 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c41bd1a9-f508-42b8-b569-831055fda00f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8e078bb9-f274-4984-8128-d31407d49604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:48:02.307320 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-3eb8d498-60a6-4311-9063-abc246d3b5e2 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Calling method '.version_select at 0x7f5508c5b430>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:02.386522 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-3eb8d498-60a6-4311-9063-abc246d3b5e2 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7" status: 200 len: 287 microversion: 2.1 time: 0.085973 Aug 31 09:48:02.392228 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 21/33] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Aug 31 09:48:02 2022] GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7 => generated 287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:02.397509 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c41bd1a9-f508-42b8-b569-831055fda00f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.844644 Aug 31 09:48:02.400318 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 13/34] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 31 09:47:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 3848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:48:02.411911 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a520c830-0b9e-4657-9d62-af0e05f3b2c2 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:02.413647 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-a520c830-0b9e-4657-9d62-af0e05f3b2c2 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:02.785124 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-a520c830-0b9e-4657-9d62-af0e05f3b2c2 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:02.808716 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a520c830-0b9e-4657-9d62-af0e05f3b2c2 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1222 microversion: 2.1 time: 0.401144 Aug 31 09:48:02.810031 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 22/35] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:02 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1222 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:03.159429 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-5ed9966e-12b1-40fa-85ad-23c234db40fa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Action: 'create', calling method: .version_select at 0x7f55082eadc0>, body: {"keypair": {"name": "tempest-keypair-702003126", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHwL9+X43ioL540wmdVh9cgwVluUe6wxi8PvABrM8lXX9IlbCzYC61cLdikYqSR/bu6yli82aKNpxK03Pz8nhNCIIoKCip9uLoDMx735ISl1YnjdIJiB2SZxFCQKq2YrA=="}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:03.227818 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-5ed9966e-12b1-40fa-85ad-23c234db40fa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Getting quotas for project 05be916a558445ee8550559d491efbd0. Resources: {'key_pairs'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:48:03.236254 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-5ed9966e-12b1-40fa-85ad-23c234db40fa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Getting quotas for user 4961545b43f74fdb87d01b78600d54ed and project 05be916a558445ee8550559d491efbd0. Resources: {'key_pairs'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:48:03.252413 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-d08c4af4-f03a-47cc-8232-cd0ba7b977e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-226793196", "imageRef": "8e078bb9-f274-4984-8128-d31407d49604", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:03.311530 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-5ed9966e-12b1-40fa-85ad-23c234db40fa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.641243 Aug 31 09:48:03.321572 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 14/36] 10.222.0.13 () {60 vars in 1159 bytes} [Wed Aug 31 09:48:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:03.401149 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9e748191-2044-4e79-80e2-83a506b339f2 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Calling method '.version_select at 0x7f5508303670>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:03.471926 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-9e748191-2044-4e79-80e2-83a506b339f2 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7" status: 200 len: 287 microversion: 2.1 time: 0.076138 Aug 31 09:48:03.472766 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 15/37] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Aug 31 09:48:03 2022] GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:03.473812 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.network.neutron [None req-d08c4af4-f03a-47cc-8232-cd0ba7b977e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] validate_networks() for [('2e69cc92-d348-4eef-9a4c-b8daacafc440', None, None, None, None, None)] {{(pid=127170) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:48:03.668954 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c2a6a75e-ff66-4711-a027-1f5ff3bc3f20 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1726997227", "imageRef": "8e078bb9-f274-4984-8128-d31407d49604", "flavorRef": "452", "networks": [{"uuid": "b1b3efd2-0245-4b54-9c30-219b3ba26247"}]}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:03.775938 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.network.neutron [None req-c2a6a75e-ff66-4711-a027-1f5ff3bc3f20 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] validate_networks() for [('b1b3efd2-0245-4b54-9c30-219b3ba26247', None, None, None, None, None)] {{(pid=127171) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:48:04.825686 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-d08c4af4-f03a-47cc-8232-cd0ba7b977e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Flavor limits 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:48:04.826173 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-d08c4af4-f03a-47cc-8232-cd0ba7b977e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Image limits 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:48:04.826653 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-d08c4af4-f03a-47cc-8232-cd0ba7b977e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Flavor pref 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:48:04.827072 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-d08c4af4-f03a-47cc-8232-cd0ba7b977e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Image pref 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:48:04.828492 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-d08c4af4-f03a-47cc-8232-cd0ba7b977e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:48:04.890452 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d08c4af4-f03a-47cc-8232-cd0ba7b977e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:04.896985 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d08c4af4-f03a-47cc-8232-cd0ba7b977e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:04.897565 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d08c4af4-f03a-47cc-8232-cd0ba7b977e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:04.903025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d08c4af4-f03a-47cc-8232-cd0ba7b977e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:04.904209 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d08c4af4-f03a-47cc-8232-cd0ba7b977e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:04.904666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d08c4af4-f03a-47cc-8232-cd0ba7b977e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:05.058883 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-d08c4af4-f03a-47cc-8232-cd0ba7b977e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Getting quotas for project c0fc6660b5494415915cdf2b325e5bd6. Resources: {'ram', 'instances', 'cores'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:48:05.074852 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-d08c4af4-f03a-47cc-8232-cd0ba7b977e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Getting quotas for user 886e40cf192d46c2b2e7eb2a95ec62e1 and project c0fc6660b5494415915cdf2b325e5bd6. Resources: {'ram', 'instances', 'cores'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:48:05.132536 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-d08c4af4-f03a-47cc-8232-cd0ba7b977e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Going to run 1 instances... {{(pid=127170) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:48:05.135691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-d08c4af4-f03a-47cc-8232-cd0ba7b977e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8e078bb9-f274-4984-8128-d31407d49604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:48:05.303905 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-d08c4af4-f03a-47cc-8232-cd0ba7b977e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.059241 Aug 31 09:48:05.305131 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 23/38] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 31 09:48:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 2061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 09:48:05.322357 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-60c4c9a7-9467-433b-a82e-f63de2426f91 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Calling method '.version_select at 0x7f5508b14310>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:05.375113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-60c4c9a7-9467-433b-a82e-f63de2426f91 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7" status: 200 len: 287 microversion: 2.1 time: 0.068491 Aug 31 09:48:05.375963 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 24/39] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Aug 31 09:48:05 2022] GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:05.390944 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-ed931eaf-ecd2-4ab0-a880-d33eeb2afc4e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:05.394973 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-ed931eaf-ecd2-4ab0-a880-d33eeb2afc4e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:06.629209 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-ed931eaf-ecd2-4ab0-a880-d33eeb2afc4e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:06.643643 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-ed931eaf-ecd2-4ab0-a880-d33eeb2afc4e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1221 microversion: 2.1 time: 1.263345 Aug 31 09:48:06.643643 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 25/40] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:05 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1221 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:06.663704 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-38a6e033-88f6-4cf9-aa44-6ced748b63c4 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Calling method '.version_select at 0x7f5508b14550>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:06.754626 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-38a6e033-88f6-4cf9-aa44-6ced748b63c4 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] HTTP exception thrown: Snapshot 3f86fe91-3522-4851-9197-1ced982ad9a7 could not be found. Aug 31 09:48:06.758294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-38a6e033-88f6-4cf9-aa44-6ced748b63c4 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Request method failure captured: Aug 31 09:48:06.758294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7 HTTP/1.1 Aug 31 09:48:06.758294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 09:48:06.758294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 09:48:06.758294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 09:48:06.758294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 09:48:06.758294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 09:48:06.758294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 09:48:06.758294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 09:48:06.758294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 09:48:06.758294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy5C65pB4tZCfTCWwb6sdiPVEBtJtPdS80cSwHMDSBAi82DXw-HkTAE9px4QFsftgpBYNcDEIpaXsALhgfQeNOvmazvqc8YFxOQKEIg6YBZNqgosMv7Q2SdVDBRKIUICfJzsOwBrb3-NfRrHNDIE3YFKkyya3-WoXRsCYKQOTy9UkWQ Aug 31 09:48:06.758294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 09:48:06.758294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 09:48:06.758294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 09:48:06.758294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 09:48:06.758294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 09:48:06.758294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 09:48:06.758294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: c8c7821da6b84645985cbe9d3f3e0f04 Aug 31 09:48:06.758294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-103500172 Aug 31 09:48:06.758294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 09:48:06.758294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 09:48:06.759658 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8c7821da6b84645985cbe9d3f3e0f04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c8c7821da6b84645985cbe9d3f3e0f04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8c7821da6b84645985cbe9d3f3e0f04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c8c7821da6b84645985cbe9d3f3e0f04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:48:06.759658 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-VolumesSnapshotsTestJSON-103500172 Aug 31 09:48:06.759658 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: c8c7821da6b84645985cbe9d3f3e0f04 Aug 31 09:48:06.759658 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-103500172 Aug 31 09:48:06.759658 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-VolumesSnapshotsTestJSON-103500172-project Aug 31 09:48:06.759658 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 09:48:06.759658 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 09:48:06.759658 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: f8bffa6c63644be1b1087916e000999a Aug 31 09:48:06.759658 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-VolumesSnapshotsTestJSON-103500172-project Aug 31 09:48:06.759658 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: Aug 31 09:48:06.759658 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Snapshot 3f86fe91-3522-4851-9197-1ced982ad9a7 could not be found. Aug 31 09:48:06.759658 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': '3f86fe91-3522-4851-9197-1ced982ad9a7'} Aug 31 09:48:06.759658 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:48:06.760460 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:06.760460 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 09:48:06.760460 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 09:48:06.760460 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 09:48:06.760460 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 09:48:06.760460 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 09:48:06.760460 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 09:48:06.760460 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:48:06.760460 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:48:06.760460 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:48:06.760460 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:48:06.760460 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:48:06.760460 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:48:06.760460 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:48:06.760460 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:48:06.760460 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3f86fe91-3522-4851-9197-1ced982ad9a7 could not be found. (HTTP 404) (Request-ID: req-80ced9b1-da8a-4e8b-9a0d-a96595baa8bb) Aug 31 09:48:06.760460 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:48:06.760460 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:06.761578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:48:06.761578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:06.761578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 31 09:48:06.761578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 31 09:48:06.761578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 09:48:06.761578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 09:48:06.761578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 31 09:48:06.761578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 31 09:48:06.761578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 09:48:06.761578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 09:48:06.761578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 09:48:06.761578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 09:48:06.761578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 09:48:06.761578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 09:48:06.761578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 09:48:06.761578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 09:48:06.761578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:48:06.761578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:48:06.761578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:48:06.762670 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:48:06.762670 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:48:06.762670 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:48:06.762670 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:48:06.762670 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:48:06.762670 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3f86fe91-3522-4851-9197-1ced982ad9a7 could not be found. Aug 31 09:48:06.762670 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:48:06.762670 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:06.762670 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:48:06.762670 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:06.762670 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:06.762670 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:06.762670 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:48:06.762670 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:48:06.762670 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:48:06.762670 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:48:06.762670 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:48:06.762670 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:48:06.762670 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 31 09:48:06.762670 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:48:06.764811 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3f86fe91-3522-4851-9197-1ced982ad9a7 could not be found. Aug 31 09:48:06.764811 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:48:06.764811 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:06.764811 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:48:06.764811 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:06.764811 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:06.764811 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:06.764811 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:48:06.764811 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:48:06.764811 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3f86fe91-3522-4851-9197-1ced982ad9a7 could not be found. Aug 31 09:48:06.764811 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:48:06.764811 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-38a6e033-88f6-4cf9-aa44-6ced748b63c4 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Returning 404 to user: Snapshot 3f86fe91-3522-4851-9197-1ced982ad9a7 could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:48:06.764811 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-38a6e033-88f6-4cf9-aa44-6ced748b63c4 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7" status: 404 len: 111 microversion: 2.1 time: 0.110813 Aug 31 09:48:06.764811 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 26/41] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Aug 31 09:48:06 2022] GET /compute/v2.1/os-snapshots/3f86fe91-3522-4851-9197-1ced982ad9a7 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:48:06.769224 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-7a8311e7-6466-4944-82de-55669e8b6a39 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Calling method '.version_select at 0x7f5508b22160>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:06.961307 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-7a8311e7-6466-4944-82de-55669e8b6a39 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/4706a65c-c5a6-422a-a381-3c66895949d8" status: 202 len: 0 microversion: 2.1 time: 0.196161 Aug 31 09:48:06.962123 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 27/42] 10.222.0.13 () {58 vars in 1248 bytes} [Wed Aug 31 09:48:06 2022] DELETE /compute/v2.1/os-volumes/4706a65c-c5a6-422a-a381-3c66895949d8 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:48:06.970587 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-1e59391b-7ea8-4a71-8d6f-323cf38a7ab6 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Calling method '.version_select at 0x7f5508b14040>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:07.292733 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-1e59391b-7ea8-4a71-8d6f-323cf38a7ab6 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/4706a65c-c5a6-422a-a381-3c66895949d8" status: 200 len: 345 microversion: 2.1 time: 0.325992 Aug 31 09:48:07.293794 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 28/43] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 31 09:48:06 2022] GET /compute/v2.1/os-volumes/4706a65c-c5a6-422a-a381-3c66895949d8 => generated 345 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:07.335191 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-c2a6a75e-ff66-4711-a027-1f5ff3bc3f20 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Flavor limits 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:48:07.337073 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-c2a6a75e-ff66-4711-a027-1f5ff3bc3f20 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Image limits 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:48:07.339145 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-c2a6a75e-ff66-4711-a027-1f5ff3bc3f20 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Flavor pref 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:48:07.340099 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-c2a6a75e-ff66-4711-a027-1f5ff3bc3f20 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Image pref 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:48:07.340627 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-c2a6a75e-ff66-4711-a027-1f5ff3bc3f20 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:48:07.363455 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c2a6a75e-ff66-4711-a027-1f5ff3bc3f20 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:07.367801 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c2a6a75e-ff66-4711-a027-1f5ff3bc3f20 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:07.368474 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c2a6a75e-ff66-4711-a027-1f5ff3bc3f20 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:07.371285 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c2a6a75e-ff66-4711-a027-1f5ff3bc3f20 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:07.372373 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c2a6a75e-ff66-4711-a027-1f5ff3bc3f20 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:07.373375 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c2a6a75e-ff66-4711-a027-1f5ff3bc3f20 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:07.497536 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-c2a6a75e-ff66-4711-a027-1f5ff3bc3f20 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Getting quotas for project eb404a7dd529496888531e7ef00fd352. Resources: {'ram', 'instances', 'cores'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:48:07.514504 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-c2a6a75e-ff66-4711-a027-1f5ff3bc3f20 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Getting quotas for user ae46122578a143a78f07f7f3a80ae079 and project eb404a7dd529496888531e7ef00fd352. Resources: {'ram', 'instances', 'cores'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:48:07.567815 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c2a6a75e-ff66-4711-a027-1f5ff3bc3f20 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Going to run 1 instances... {{(pid=127171) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:48:07.576479 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c2a6a75e-ff66-4711-a027-1f5ff3bc3f20 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8e078bb9-f274-4984-8128-d31407d49604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:48:07.667433 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-9cf2f6a9-0dd6-44d5-bd7b-0da37d66ab9d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:07.668061 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-9cf2f6a9-0dd6-44d5-bd7b-0da37d66ab9d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:07.681828 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9cf2f6a9-0dd6-44d5-bd7b-0da37d66ab9d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:07.682511 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9cf2f6a9-0dd6-44d5-bd7b-0da37d66ab9d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:07.683134 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9cf2f6a9-0dd6-44d5-bd7b-0da37d66ab9d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:07.684007 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9cf2f6a9-0dd6-44d5-bd7b-0da37d66ab9d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:07.687474 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9cf2f6a9-0dd6-44d5-bd7b-0da37d66ab9d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:07.688125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9cf2f6a9-0dd6-44d5-bd7b-0da37d66ab9d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:07.697806 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c2a6a75e-ff66-4711-a027-1f5ff3bc3f20 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.130126 Aug 31 09:48:07.701691 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 16/44] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 31 09:48:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 4134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 09:48:07.725311 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-90c31f58-fdf1-466b-b24d-de61dde9a050 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:07.726243 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-90c31f58-fdf1-466b-b24d-de61dde9a050 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:08.082563 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-90c31f58-fdf1-466b-b24d-de61dde9a050 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:08.118564 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-90c31f58-fdf1-466b-b24d-de61dde9a050 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1215 microversion: 2.1 time: 0.406650 Aug 31 09:48:08.133131 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 17/45] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:07 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1215 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:08.176307 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-9cf2f6a9-0dd6-44d5-bd7b-0da37d66ab9d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:08.229447 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-9cf2f6a9-0dd6-44d5-bd7b-0da37d66ab9d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1273 microversion: 2.1 time: 0.565241 Aug 31 09:48:08.248267 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 29/46] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:07 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1273 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:08.307430 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c850b2e6-6d03-4522-bf16-6978932dafd8 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Calling method '.version_select at 0x7f55082a7e50>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:08.369211 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.wsgi [None req-c850b2e6-6d03-4522-bf16-6978932dafd8 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] HTTP exception thrown: Volume 4706a65c-c5a6-422a-a381-3c66895949d8 could not be found. Aug 31 09:48:08.371353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c850b2e6-6d03-4522-bf16-6978932dafd8 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Request method failure captured: Aug 31 09:48:08.371353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: request: GET /compute/v2.1/os-volumes/4706a65c-c5a6-422a-a381-3c66895949d8 HTTP/1.1 Aug 31 09:48:08.371353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept: application/json Aug 31 09:48:08.371353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept-Encoding: identity Aug 31 09:48:08.371353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Connection: close Aug 31 09:48:08.371353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Length: 0 Aug 31 09:48:08.371353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Type: application/json Aug 31 09:48:08.371353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Host: 10.222.0.13 Aug 31 09:48:08.371353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Openstack-System-Scope: None Aug 31 09:48:08.371353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: User-Agent: python-urllib3/1.26.12 Aug 31 09:48:08.371353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Auth-Token: gAAAAABjDy5C65pB4tZCfTCWwb6sdiPVEBtJtPdS80cSwHMDSBAi82DXw-HkTAE9px4QFsftgpBYNcDEIpaXsALhgfQeNOvmazvqc8YFxOQKEIg6YBZNqgosMv7Q2SdVDBRKIUICfJzsOwBrb3-NfRrHNDIE3YFKkyya3-WoXRsCYKQOTy9UkWQ Aug 31 09:48:08.371353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Id: None Aug 31 09:48:08.371353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Name: None Aug 31 09:48:08.371353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Identity-Status: Confirmed Aug 31 09:48:08.371353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Is-Admin-Project: True Aug 31 09:48:08.371353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Id: default Aug 31 09:48:08.371353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Name: Default Aug 31 09:48:08.371353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Id: c8c7821da6b84645985cbe9d3f3e0f04 Aug 31 09:48:08.371353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-103500172 Aug 31 09:48:08.371353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Role: member,reader Aug 31 09:48:08.371353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Roles: member,reader Aug 31 09:48:08.372500 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8c7821da6b84645985cbe9d3f3e0f04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c8c7821da6b84645985cbe9d3f3e0f04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8c7821da6b84645985cbe9d3f3e0f04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c8c7821da6b84645985cbe9d3f3e0f04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:48:08.372500 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant: tempest-VolumesSnapshotsTestJSON-103500172 Aug 31 09:48:08.372500 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Id: c8c7821da6b84645985cbe9d3f3e0f04 Aug 31 09:48:08.372500 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-103500172 Aug 31 09:48:08.372500 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User: tempest-VolumesSnapshotsTestJSON-103500172-project Aug 31 09:48:08.372500 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Id: default Aug 31 09:48:08.372500 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Name: Default Aug 31 09:48:08.372500 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Id: f8bffa6c63644be1b1087916e000999a Aug 31 09:48:08.372500 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Name: tempest-VolumesSnapshotsTestJSON-103500172-project Aug 31 09:48:08.372500 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: method: Aug 31 09:48:08.372500 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: exception: Volume 4706a65c-c5a6-422a-a381-3c66895949d8 could not be found. Aug 31 09:48:08.372500 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: action_args: {'id': '4706a65c-c5a6-422a-a381-3c66895949d8'} Aug 31 09:48:08.372500 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:48:08.373154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:08.373154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:48:08.373154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:48:08.373154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 09:48:08.373154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 09:48:08.373154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 09:48:08.373154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 09:48:08.373154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:48:08.373154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:48:08.373154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:48:08.373154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:48:08.373154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:48:08.373154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:48:08.373154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:48:08.373154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:48:08.373154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4706a65c-c5a6-422a-a381-3c66895949d8 could not be found. (HTTP 404) (Request-ID: req-1ea54eb2-8e1f-4026-ba02-ae844a786d9e) Aug 31 09:48:08.373154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:48:08.373154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:08.373154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:48:08.378986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:08.378986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 09:48:08.378986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 09:48:08.378986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 09:48:08.378986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 09:48:08.378986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 09:48:08.378986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 09:48:08.378986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 09:48:08.378986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 09:48:08.378986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:48:08.378986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:48:08.378986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 09:48:08.378986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 09:48:08.378986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 09:48:08.378986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 09:48:08.378986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:48:08.378986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:48:08.378986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:48:08.378986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:48:08.380146 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:48:08.380146 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:48:08.380146 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:48:08.380146 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:48:08.380146 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4706a65c-c5a6-422a-a381-3c66895949d8 could not be found. Aug 31 09:48:08.380146 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:48:08.380146 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:08.380146 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:48:08.380146 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:08.380146 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:08.380146 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:08.380146 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:48:08.380146 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:48:08.380146 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:48:08.380146 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:48:08.380146 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:48:08.380146 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:48:08.380146 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 09:48:08.380146 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:48:08.381237 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4706a65c-c5a6-422a-a381-3c66895949d8 could not be found. Aug 31 09:48:08.381237 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:48:08.381237 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:08.381237 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:48:08.381237 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:08.381237 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:08.381237 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:08.381237 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:48:08.381237 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:48:08.381237 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4706a65c-c5a6-422a-a381-3c66895949d8 could not be found. Aug 31 09:48:08.381237 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:48:08.381237 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c850b2e6-6d03-4522-bf16-6978932dafd8 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Returning 404 to user: Volume 4706a65c-c5a6-422a-a381-3c66895949d8 could not be found. {{(pid=127171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:48:08.381237 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c850b2e6-6d03-4522-bf16-6978932dafd8 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/4706a65c-c5a6-422a-a381-3c66895949d8" status: 404 len: 109 microversion: 2.1 time: 0.069767 Aug 31 09:48:08.381237 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 18/47] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 31 09:48:08 2022] GET /compute/v2.1/os-volumes/4706a65c-c5a6-422a-a381-3c66895949d8 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:48:08.384288 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-974460d0-3aad-40c4-a81d-9a25722ca96b tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Calling method '.version_select at 0x7f5508290ca0>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:08.462597 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-974460d0-3aad-40c4-a81d-9a25722ca96b tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] HTTP exception thrown: Volume 4706a65c-c5a6-422a-a381-3c66895949d8 could not be found. Aug 31 09:48:08.464843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-974460d0-3aad-40c4-a81d-9a25722ca96b tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Request method failure captured: Aug 31 09:48:08.464843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: DELETE /compute/v2.1/os-volumes/4706a65c-c5a6-422a-a381-3c66895949d8 HTTP/1.1 Aug 31 09:48:08.464843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 09:48:08.464843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 09:48:08.464843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 09:48:08.464843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 09:48:08.464843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 09:48:08.464843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 09:48:08.464843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 09:48:08.464843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 09:48:08.464843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy5C65pB4tZCfTCWwb6sdiPVEBtJtPdS80cSwHMDSBAi82DXw-HkTAE9px4QFsftgpBYNcDEIpaXsALhgfQeNOvmazvqc8YFxOQKEIg6YBZNqgosMv7Q2SdVDBRKIUICfJzsOwBrb3-NfRrHNDIE3YFKkyya3-WoXRsCYKQOTy9UkWQ Aug 31 09:48:08.464843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 09:48:08.464843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 09:48:08.464843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 09:48:08.464843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 09:48:08.464843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 09:48:08.464843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 09:48:08.464843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: c8c7821da6b84645985cbe9d3f3e0f04 Aug 31 09:48:08.464843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-103500172 Aug 31 09:48:08.464843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 09:48:08.464843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 09:48:08.466133 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8c7821da6b84645985cbe9d3f3e0f04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c8c7821da6b84645985cbe9d3f3e0f04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8c7821da6b84645985cbe9d3f3e0f04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c8c7821da6b84645985cbe9d3f3e0f04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:48:08.466133 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-VolumesSnapshotsTestJSON-103500172 Aug 31 09:48:08.466133 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: c8c7821da6b84645985cbe9d3f3e0f04 Aug 31 09:48:08.466133 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-103500172 Aug 31 09:48:08.466133 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-VolumesSnapshotsTestJSON-103500172-project Aug 31 09:48:08.466133 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 09:48:08.466133 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 09:48:08.466133 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: f8bffa6c63644be1b1087916e000999a Aug 31 09:48:08.466133 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-VolumesSnapshotsTestJSON-103500172-project Aug 31 09:48:08.466133 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: Aug 31 09:48:08.466133 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Volume 4706a65c-c5a6-422a-a381-3c66895949d8 could not be found. Aug 31 09:48:08.466133 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': '4706a65c-c5a6-422a-a381-3c66895949d8'} Aug 31 09:48:08.466133 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:48:08.466920 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:08.466920 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:48:08.466920 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:48:08.466920 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 09:48:08.466920 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 09:48:08.466920 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 09:48:08.466920 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 09:48:08.466920 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 09:48:08.466920 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 09:48:08.466920 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 09:48:08.466920 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 09:48:08.466920 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:48:08.466920 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:48:08.466920 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:48:08.466920 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:48:08.466920 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4706a65c-c5a6-422a-a381-3c66895949d8 could not be found. (HTTP 404) (Request-ID: req-acba9b7a-7e95-430a-b0b9-8258370216b4) Aug 31 09:48:08.466920 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:48:08.466920 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:08.466920 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:48:08.468025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:08.468025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 09:48:08.468025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 09:48:08.468025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 09:48:08.468025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 09:48:08.468025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 09:48:08.468025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 09:48:08.468025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 09:48:08.468025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 09:48:08.468025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:48:08.468025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:48:08.468025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 09:48:08.468025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 09:48:08.468025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 09:48:08.468025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 09:48:08.468025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 09:48:08.468025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 09:48:08.468025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 09:48:08.468025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 09:48:08.469135 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:48:08.469135 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:48:08.469135 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:48:08.469135 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:48:08.469135 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4706a65c-c5a6-422a-a381-3c66895949d8 could not be found. Aug 31 09:48:08.469135 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:48:08.469135 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:08.469135 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:48:08.469135 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:08.469135 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:08.469135 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:08.469135 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:48:08.469135 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:48:08.469135 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:48:08.469135 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:48:08.469135 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:48:08.469135 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:48:08.469135 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 09:48:08.469135 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:48:08.470257 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4706a65c-c5a6-422a-a381-3c66895949d8 could not be found. Aug 31 09:48:08.470257 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:48:08.470257 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:08.470257 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:48:08.470257 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:08.470257 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:08.470257 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:08.470257 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:48:08.470257 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:48:08.470257 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4706a65c-c5a6-422a-a381-3c66895949d8 could not be found. Aug 31 09:48:08.470257 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:48:08.470257 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-974460d0-3aad-40c4-a81d-9a25722ca96b tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Returning 404 to user: Volume 4706a65c-c5a6-422a-a381-3c66895949d8 could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:48:08.470257 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-974460d0-3aad-40c4-a81d-9a25722ca96b tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/4706a65c-c5a6-422a-a381-3c66895949d8" status: 404 len: 109 microversion: 2.1 time: 0.087871 Aug 31 09:48:08.470257 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 30/48] 10.222.0.13 () {58 vars in 1248 bytes} [Wed Aug 31 09:48:08 2022] DELETE /compute/v2.1/os-volumes/4706a65c-c5a6-422a-a381-3c66895949d8 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:48:08.477338 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-4c744d8d-8a02-4fdf-b023-a409627270c0 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Calling method '.version_select at 0x7f55082d74c0>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:08.565641 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.wsgi [None req-4c744d8d-8a02-4fdf-b023-a409627270c0 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] HTTP exception thrown: Volume 4706a65c-c5a6-422a-a381-3c66895949d8 could not be found. Aug 31 09:48:08.567743 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-4c744d8d-8a02-4fdf-b023-a409627270c0 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Request method failure captured: Aug 31 09:48:08.567743 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: request: GET /compute/v2.1/os-volumes/4706a65c-c5a6-422a-a381-3c66895949d8 HTTP/1.1 Aug 31 09:48:08.567743 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept: application/json Aug 31 09:48:08.567743 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept-Encoding: identity Aug 31 09:48:08.567743 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Connection: close Aug 31 09:48:08.567743 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Length: 0 Aug 31 09:48:08.567743 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Type: application/json Aug 31 09:48:08.567743 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Host: 10.222.0.13 Aug 31 09:48:08.567743 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Openstack-System-Scope: None Aug 31 09:48:08.567743 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: User-Agent: python-urllib3/1.26.12 Aug 31 09:48:08.567743 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Auth-Token: gAAAAABjDy5C65pB4tZCfTCWwb6sdiPVEBtJtPdS80cSwHMDSBAi82DXw-HkTAE9px4QFsftgpBYNcDEIpaXsALhgfQeNOvmazvqc8YFxOQKEIg6YBZNqgosMv7Q2SdVDBRKIUICfJzsOwBrb3-NfRrHNDIE3YFKkyya3-WoXRsCYKQOTy9UkWQ Aug 31 09:48:08.567743 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Id: None Aug 31 09:48:08.567743 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Name: None Aug 31 09:48:08.567743 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Identity-Status: Confirmed Aug 31 09:48:08.567743 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Is-Admin-Project: True Aug 31 09:48:08.567743 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Id: default Aug 31 09:48:08.567743 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Name: Default Aug 31 09:48:08.567743 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Id: c8c7821da6b84645985cbe9d3f3e0f04 Aug 31 09:48:08.567743 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-103500172 Aug 31 09:48:08.567743 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Role: member,reader Aug 31 09:48:08.567743 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Roles: member,reader Aug 31 09:48:08.576467 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8c7821da6b84645985cbe9d3f3e0f04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c8c7821da6b84645985cbe9d3f3e0f04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8c7821da6b84645985cbe9d3f3e0f04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c8c7821da6b84645985cbe9d3f3e0f04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:48:08.576467 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant: tempest-VolumesSnapshotsTestJSON-103500172 Aug 31 09:48:08.576467 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Id: c8c7821da6b84645985cbe9d3f3e0f04 Aug 31 09:48:08.576467 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-103500172 Aug 31 09:48:08.576467 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User: tempest-VolumesSnapshotsTestJSON-103500172-project Aug 31 09:48:08.576467 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Id: default Aug 31 09:48:08.576467 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Name: Default Aug 31 09:48:08.576467 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Id: f8bffa6c63644be1b1087916e000999a Aug 31 09:48:08.576467 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Name: tempest-VolumesSnapshotsTestJSON-103500172-project Aug 31 09:48:08.576467 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: method: Aug 31 09:48:08.576467 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: exception: Volume 4706a65c-c5a6-422a-a381-3c66895949d8 could not be found. Aug 31 09:48:08.576467 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: action_args: {'id': '4706a65c-c5a6-422a-a381-3c66895949d8'} Aug 31 09:48:08.576467 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:48:08.577177 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:08.577177 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:48:08.577177 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:48:08.577177 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 09:48:08.577177 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 09:48:08.577177 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 09:48:08.577177 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 09:48:08.577177 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:48:08.577177 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:48:08.577177 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:48:08.577177 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:48:08.577177 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:48:08.577177 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:48:08.577177 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:48:08.577177 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:48:08.577177 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4706a65c-c5a6-422a-a381-3c66895949d8 could not be found. (HTTP 404) (Request-ID: req-d5fc4dfb-a382-44c0-9e53-de89e5c0c899) Aug 31 09:48:08.577177 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:48:08.577177 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:08.577177 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:48:08.578173 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:08.578173 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 09:48:08.578173 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 09:48:08.578173 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 09:48:08.578173 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 09:48:08.578173 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 09:48:08.578173 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 09:48:08.578173 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 09:48:08.578173 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 09:48:08.578173 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:48:08.578173 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:48:08.578173 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 09:48:08.578173 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 09:48:08.578173 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 09:48:08.578173 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 09:48:08.578173 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:48:08.578173 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:48:08.578173 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:48:08.578173 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:48:08.579159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:48:08.579159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:48:08.579159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:48:08.579159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:48:08.579159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4706a65c-c5a6-422a-a381-3c66895949d8 could not be found. Aug 31 09:48:08.579159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:48:08.579159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:08.579159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:48:08.579159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:08.579159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:08.579159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:08.579159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:48:08.579159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:48:08.579159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:48:08.579159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:48:08.579159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:48:08.579159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:48:08.579159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 09:48:08.579159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:48:08.580717 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4706a65c-c5a6-422a-a381-3c66895949d8 could not be found. Aug 31 09:48:08.580717 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:48:08.580717 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:08.580717 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:48:08.580717 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:08.580717 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:08.580717 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:08.580717 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:48:08.580717 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:48:08.580717 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4706a65c-c5a6-422a-a381-3c66895949d8 could not be found. Aug 31 09:48:08.580717 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:48:08.580717 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-4c744d8d-8a02-4fdf-b023-a409627270c0 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] Returning 404 to user: Volume 4706a65c-c5a6-422a-a381-3c66895949d8 could not be found. {{(pid=127171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:48:08.580717 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-4c744d8d-8a02-4fdf-b023-a409627270c0 tempest-VolumesSnapshotsTestJSON-103500172 tempest-VolumesSnapshotsTestJSON-103500172-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/4706a65c-c5a6-422a-a381-3c66895949d8" status: 404 len: 109 microversion: 2.1 time: 0.096534 Aug 31 09:48:08.580717 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 19/49] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 31 09:48:08 2022] GET /compute/v2.1/os-volumes/4706a65c-c5a6-422a-a381-3c66895949d8 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 09:48:09.143597 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-90eeec04-33d2-4e99-9b46-fcd920b27e83 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:09.144226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-90eeec04-33d2-4e99-9b46-fcd920b27e83 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:09.181939 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-90eeec04-33d2-4e99-9b46-fcd920b27e83 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:09.190021 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-90eeec04-33d2-4e99-9b46-fcd920b27e83 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:09.201869 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-90eeec04-33d2-4e99-9b46-fcd920b27e83 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:09.208965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-90eeec04-33d2-4e99-9b46-fcd920b27e83 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:09.216150 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-90eeec04-33d2-4e99-9b46-fcd920b27e83 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:09.220304 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-90eeec04-33d2-4e99-9b46-fcd920b27e83 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:09.261926 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-2cbd49ef-27e4-427c-abe4-142aa6f33063 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:09.264046 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-2cbd49ef-27e4-427c-abe4-142aa6f33063 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:09.290639 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2cbd49ef-27e4-427c-abe4-142aa6f33063 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:09.291387 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2cbd49ef-27e4-427c-abe4-142aa6f33063 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:09.292497 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2cbd49ef-27e4-427c-abe4-142aa6f33063 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:09.296898 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2cbd49ef-27e4-427c-abe4-142aa6f33063 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:09.297792 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2cbd49ef-27e4-427c-abe4-142aa6f33063 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:09.298524 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2cbd49ef-27e4-427c-abe4-142aa6f33063 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:09.776419 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-90eeec04-33d2-4e99-9b46-fcd920b27e83 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:09.784808 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-90eeec04-33d2-4e99-9b46-fcd920b27e83 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1219 microversion: 2.1 time: 0.646454 Aug 31 09:48:09.795266 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 31/50] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:09 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1219 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:10.193241 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2cbd49ef-27e4-427c-abe4-142aa6f33063 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:10.243940 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-2cbd49ef-27e4-427c-abe4-142aa6f33063 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1279 microversion: 2.1 time: 0.991307 Aug 31 09:48:10.282096 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 20/51] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:09 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1279 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:10.568522 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-ce48f98b-50ed-4171-b5d9-65db0532a48f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1776927434", "imageRef": "8e078bb9-f274-4984-8128-d31407d49604", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36c1318a-9832-4bc9-ac1a-5f597bd8ac6c"}], "security_groups": [{"name": "tempest-securitygroup--1121481318"}], "key_name": "tempest-keypair-702003126", "user_data": "}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:10.808224 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-e8170b6a-5915-4b0a-b276-b2858b10caf1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:10.808868 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-e8170b6a-5915-4b0a-b276-b2858b10caf1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:10.819854 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e8170b6a-5915-4b0a-b276-b2858b10caf1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:10.820369 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e8170b6a-5915-4b0a-b276-b2858b10caf1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:10.827668 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e8170b6a-5915-4b0a-b276-b2858b10caf1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:10.830424 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e8170b6a-5915-4b0a-b276-b2858b10caf1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:10.831291 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e8170b6a-5915-4b0a-b276-b2858b10caf1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:10.839171 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e8170b6a-5915-4b0a-b276-b2858b10caf1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:11.593375 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.network.neutron [None req-ce48f98b-50ed-4171-b5d9-65db0532a48f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] validate_networks() for [('36c1318a-9832-4bc9-ac1a-5f597bd8ac6c', None, None, None, None, None)] {{(pid=127170) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:48:12.169001 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-e8170b6a-5915-4b0a-b276-b2858b10caf1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:12.192895 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-e8170b6a-5915-4b0a-b276-b2858b10caf1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1267 microversion: 2.1 time: 1.388276 Aug 31 09:48:12.202773 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 21/52] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:10 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1267 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:48:12.246379 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-cd77fcb1-a162-4222-9625-aef1f066cd8a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:12.255204 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-cd77fcb1-a162-4222-9625-aef1f066cd8a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:12.294738 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cd77fcb1-a162-4222-9625-aef1f066cd8a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:12.313931 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cd77fcb1-a162-4222-9625-aef1f066cd8a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:12.315876 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cd77fcb1-a162-4222-9625-aef1f066cd8a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:12.318612 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cd77fcb1-a162-4222-9625-aef1f066cd8a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:12.322732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cd77fcb1-a162-4222-9625-aef1f066cd8a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:12.324030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cd77fcb1-a162-4222-9625-aef1f066cd8a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:13.223634 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-cd77fcb1-a162-4222-9625-aef1f066cd8a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:13.311351 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-cd77fcb1-a162-4222-9625-aef1f066cd8a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1279 microversion: 2.1 time: 1.106284 Aug 31 09:48:13.313314 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 22/53] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:12 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1279 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:13.326973 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-1b17fb17-d35f-4a74-9b84-34f8df0a9cae tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:13.328007 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-1b17fb17-d35f-4a74-9b84-34f8df0a9cae tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:13.352558 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1b17fb17-d35f-4a74-9b84-34f8df0a9cae tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:13.355700 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1b17fb17-d35f-4a74-9b84-34f8df0a9cae tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:13.358773 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1b17fb17-d35f-4a74-9b84-34f8df0a9cae tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:13.365934 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1b17fb17-d35f-4a74-9b84-34f8df0a9cae tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:13.370374 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1b17fb17-d35f-4a74-9b84-34f8df0a9cae tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:13.374434 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1b17fb17-d35f-4a74-9b84-34f8df0a9cae tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:13.962480 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-1b17fb17-d35f-4a74-9b84-34f8df0a9cae tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:13.972226 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-1b17fb17-d35f-4a74-9b84-34f8df0a9cae tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1273 microversion: 2.1 time: 0.656948 Aug 31 09:48:13.977744 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 23/54] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:13 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1273 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:14.336954 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-a577972a-28af-4381-8e45-47c6e6ccaaa0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:14.338467 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-a577972a-28af-4381-8e45-47c6e6ccaaa0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:14.357485 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a577972a-28af-4381-8e45-47c6e6ccaaa0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:14.376003 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a577972a-28af-4381-8e45-47c6e6ccaaa0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:14.380330 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a577972a-28af-4381-8e45-47c6e6ccaaa0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:14.381786 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a577972a-28af-4381-8e45-47c6e6ccaaa0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:14.382481 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a577972a-28af-4381-8e45-47c6e6ccaaa0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:14.383544 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a577972a-28af-4381-8e45-47c6e6ccaaa0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:14.981140 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=2 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:15.304493 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-a577972a-28af-4381-8e45-47c6e6ccaaa0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:15.326686 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-a577972a-28af-4381-8e45-47c6e6ccaaa0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1279 microversion: 2.1 time: 0.995027 Aug 31 09:48:15.345291 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 24/55] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:14 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1279 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:15.367554 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-af786d10-d6bd-432c-a064-1c5d733193b7 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:15.368628 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-af786d10-d6bd-432c-a064-1c5d733193b7 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:15.410163 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-af786d10-d6bd-432c-a064-1c5d733193b7 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:15.415323 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-af786d10-d6bd-432c-a064-1c5d733193b7 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:15.417849 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-af786d10-d6bd-432c-a064-1c5d733193b7 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:15.420882 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-af786d10-d6bd-432c-a064-1c5d733193b7 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:15.425154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-af786d10-d6bd-432c-a064-1c5d733193b7 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:15.429540 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-af786d10-d6bd-432c-a064-1c5d733193b7 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:16.157706 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-af786d10-d6bd-432c-a064-1c5d733193b7 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:16.179170 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-af786d10-d6bd-432c-a064-1c5d733193b7 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1273 microversion: 2.1 time: 0.831318 Aug 31 09:48:16.190678 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 25/56] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:15 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1273 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:16.245210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-ce48f98b-50ed-4171-b5d9-65db0532a48f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Flavor limits 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:48:16.250577 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-ce48f98b-50ed-4171-b5d9-65db0532a48f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Image limits 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:48:16.252931 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-ce48f98b-50ed-4171-b5d9-65db0532a48f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Flavor pref 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:48:16.253498 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-ce48f98b-50ed-4171-b5d9-65db0532a48f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Image pref 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:48:16.254628 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-ce48f98b-50ed-4171-b5d9-65db0532a48f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:48:16.289520 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ce48f98b-50ed-4171-b5d9-65db0532a48f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:16.293674 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ce48f98b-50ed-4171-b5d9-65db0532a48f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:16.294290 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ce48f98b-50ed-4171-b5d9-65db0532a48f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:16.300817 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ce48f98b-50ed-4171-b5d9-65db0532a48f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:16.305352 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ce48f98b-50ed-4171-b5d9-65db0532a48f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:16.307982 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ce48f98b-50ed-4171-b5d9-65db0532a48f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:16.380295 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-3029551b-992e-49c7-aae8-7b5ad2812741 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:16.382014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-3029551b-992e-49c7-aae8-7b5ad2812741 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:16.389567 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-ce48f98b-50ed-4171-b5d9-65db0532a48f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Getting quotas for project 05be916a558445ee8550559d491efbd0. Resources: {'ram', 'instances', 'cores'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:48:16.397184 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3029551b-992e-49c7-aae8-7b5ad2812741 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:16.400354 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3029551b-992e-49c7-aae8-7b5ad2812741 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:16.401141 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3029551b-992e-49c7-aae8-7b5ad2812741 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:16.402879 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3029551b-992e-49c7-aae8-7b5ad2812741 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:16.405181 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3029551b-992e-49c7-aae8-7b5ad2812741 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:16.408187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3029551b-992e-49c7-aae8-7b5ad2812741 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:16.414778 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-ce48f98b-50ed-4171-b5d9-65db0532a48f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Getting quotas for user 4961545b43f74fdb87d01b78600d54ed and project 05be916a558445ee8550559d491efbd0. Resources: {'ram', 'instances', 'cores'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:48:16.482322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-ce48f98b-50ed-4171-b5d9-65db0532a48f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Going to run 1 instances... {{(pid=127170) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:48:16.484785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-ce48f98b-50ed-4171-b5d9-65db0532a48f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8e078bb9-f274-4984-8128-d31407d49604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:48:16.607906 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-ce48f98b-50ed-4171-b5d9-65db0532a48f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.044763 Aug 31 09:48:16.609455 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 32/57] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 31 09:48:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 6047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:48:16.621288 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-74dca73c-46a8-4262-974b-3a028ad54a14 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:16.622617 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-74dca73c-46a8-4262-974b-3a028ad54a14 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:16.854301 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-74dca73c-46a8-4262-974b-3a028ad54a14 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:16.862445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-74dca73c-46a8-4262-974b-3a028ad54a14 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1237 microversion: 2.1 time: 0.245686 Aug 31 09:48:16.870544 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 33/58] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:16 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1237 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:48:17.230067 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-eff38718-d431-4672-bf3f-4156821d132a tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:17.230695 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-eff38718-d431-4672-bf3f-4156821d132a tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:17.248945 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-eff38718-d431-4672-bf3f-4156821d132a tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:17.250774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-eff38718-d431-4672-bf3f-4156821d132a tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:17.251255 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-eff38718-d431-4672-bf3f-4156821d132a tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:17.252008 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-eff38718-d431-4672-bf3f-4156821d132a tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:17.252734 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-eff38718-d431-4672-bf3f-4156821d132a tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:17.253162 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-eff38718-d431-4672-bf3f-4156821d132a tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:17.460250 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=4 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:17.674205 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-3029551b-992e-49c7-aae8-7b5ad2812741 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:17.730610 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-3029551b-992e-49c7-aae8-7b5ad2812741 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1321 microversion: 2.1 time: 1.353142 Aug 31 09:48:17.756274 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 26/59] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:16 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1321 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:17.904799 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-5d735f08-43ae-4220-aa08-904f30c4df49 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:17.914362 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-5d735f08-43ae-4220-aa08-904f30c4df49 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:18.099317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=18 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:18.307266 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-eff38718-d431-4672-bf3f-4156821d132a tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:18.335036 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-eff38718-d431-4672-bf3f-4156821d132a tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1315 microversion: 2.1 time: 1.110497 Aug 31 09:48:18.336055 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 34/60] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:17 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1315 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:18.342007 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-5d735f08-43ae-4220-aa08-904f30c4df49 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:18.373848 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-5d735f08-43ae-4220-aa08-904f30c4df49 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1237 microversion: 2.1 time: 0.479330 Aug 31 09:48:18.386262 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 27/61] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:17 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1237 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:18.768418 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-9de91782-4316-49ac-874d-6c212ae5954f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:18.772254 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-9de91782-4316-49ac-874d-6c212ae5954f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:18.796034 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9de91782-4316-49ac-874d-6c212ae5954f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:18.848627 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9de91782-4316-49ac-874d-6c212ae5954f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:18.854051 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9de91782-4316-49ac-874d-6c212ae5954f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:18.862992 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9de91782-4316-49ac-874d-6c212ae5954f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:18.864249 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9de91782-4316-49ac-874d-6c212ae5954f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:18.880473 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9de91782-4316-49ac-874d-6c212ae5954f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:19.382733 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-fa8267fe-8a42-40f9-912c-03754ec9868e tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:19.386141 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-fa8267fe-8a42-40f9-912c-03754ec9868e tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:19.415351 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fa8267fe-8a42-40f9-912c-03754ec9868e tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:19.418667 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fa8267fe-8a42-40f9-912c-03754ec9868e tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:19.420521 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fa8267fe-8a42-40f9-912c-03754ec9868e tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:19.426486 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fa8267fe-8a42-40f9-912c-03754ec9868e tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:19.427617 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fa8267fe-8a42-40f9-912c-03754ec9868e tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:19.434219 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fa8267fe-8a42-40f9-912c-03754ec9868e tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:21.101874 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-9de91782-4316-49ac-874d-6c212ae5954f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:21.123646 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-9de91782-4316-49ac-874d-6c212ae5954f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1321 microversion: 2.1 time: 2.353482 Aug 31 09:48:21.124611 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 35/62] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:18 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1321 bytes in 2361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:21.136211 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-fa8267fe-8a42-40f9-912c-03754ec9868e tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:21.164467 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-3de0bf0a-5033-4de7-9f57-0b569316b0f6 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:21.169107 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-3de0bf0a-5033-4de7-9f57-0b569316b0f6 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:21.197169 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3de0bf0a-5033-4de7-9f57-0b569316b0f6 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:21.203490 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3de0bf0a-5033-4de7-9f57-0b569316b0f6 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:21.204969 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3de0bf0a-5033-4de7-9f57-0b569316b0f6 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:21.212898 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3de0bf0a-5033-4de7-9f57-0b569316b0f6 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:21.213830 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3de0bf0a-5033-4de7-9f57-0b569316b0f6 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:21.214426 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3de0bf0a-5033-4de7-9f57-0b569316b0f6 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:21.224585 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-fa8267fe-8a42-40f9-912c-03754ec9868e tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1315 microversion: 2.1 time: 1.845489 Aug 31 09:48:21.228436 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 28/63] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:19 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1315 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:21.668176 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-3de0bf0a-5033-4de7-9f57-0b569316b0f6 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:21.682385 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-3de0bf0a-5033-4de7-9f57-0b569316b0f6 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1307 microversion: 2.1 time: 0.544597 Aug 31 09:48:21.683073 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 36/64] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:21 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1307 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:22.082803 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-6a3a3077-9c1e-43f3-b9c4-84f32c643583 req-b69b048a-aac0-4d42-a83d-8e6df08ab237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd0a166f-d662-4a72-8ea2-bfbbb02b2221", "tag": "dc0a1702-552b-409c-91a1-5a380acf6fea"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:22.161874 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-00050970-eda8-4363-84da-47a7470adc88 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:22.165343 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-00050970-eda8-4363-84da-47a7470adc88 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:22.174298 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-6a3a3077-9c1e-43f3-b9c4-84f32c643583 req-b69b048a-aac0-4d42-a83d-8e6df08ab237 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:22.175471 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-6a3a3077-9c1e-43f3-b9c4-84f32c643583 req-b69b048a-aac0-4d42-a83d-8e6df08ab237 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:22.179699 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-6a3a3077-9c1e-43f3-b9c4-84f32c643583 req-b69b048a-aac0-4d42-a83d-8e6df08ab237 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:22.204346 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-00050970-eda8-4363-84da-47a7470adc88 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:22.206004 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-00050970-eda8-4363-84da-47a7470adc88 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:22.220071 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-00050970-eda8-4363-84da-47a7470adc88 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:22.221109 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-00050970-eda8-4363-84da-47a7470adc88 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:22.221693 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-00050970-eda8-4363-84da-47a7470adc88 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:22.222312 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-00050970-eda8-4363-84da-47a7470adc88 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:22.387523 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-6a3a3077-9c1e-43f3-b9c4-84f32c643583 req-b69b048a-aac0-4d42-a83d-8e6df08ab237 service nova] Creating event network-changed:dc0a1702-552b-409c-91a1-5a380acf6fea for instance dd0a166f-d662-4a72-8ea2-bfbbb02b2221 on hv-cinder-84496 Aug 31 09:48:22.397885 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-6a3a3077-9c1e-43f3-b9c4-84f32c643583 req-b69b048a-aac0-4d42-a83d-8e6df08ab237 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127171) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 09:48:22.401796 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-6a3a3077-9c1e-43f3-b9c4-84f32c643583 req-b69b048a-aac0-4d42-a83d-8e6df08ab237 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127171) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 09:48:22.409740 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0444628f-b878-4705-8ba7-a2a7dc70719d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:22.423118 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0444628f-b878-4705-8ba7-a2a7dc70719d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:22.425258 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0444628f-b878-4705-8ba7-a2a7dc70719d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:22.433057 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0444628f-b878-4705-8ba7-a2a7dc70719d None None] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:22.435975 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0444628f-b878-4705-8ba7-a2a7dc70719d None None] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:22.444009 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0444628f-b878-4705-8ba7-a2a7dc70719d None None] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:22.505271 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.compute.rpcapi [None req-0444628f-b878-4705-8ba7-a2a7dc70719d None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 09:48:22.510537 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0444628f-b878-4705-8ba7-a2a7dc70719d None None] Releasing lock "compute-rpcapi-router" {{(pid=127171) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 09:48:22.552993 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-0444628f-b878-4705-8ba7-a2a7dc70719d None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.320798 Aug 31 09:48:22.554203 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 29/65] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:22.560365 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-8b10e798-a50f-48b7-a8de-14ca6bbd8c33 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:22.565499 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-8b10e798-a50f-48b7-a8de-14ca6bbd8c33 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:22.585322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8b10e798-a50f-48b7-a8de-14ca6bbd8c33 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:22.599371 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8b10e798-a50f-48b7-a8de-14ca6bbd8c33 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:22.600155 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8b10e798-a50f-48b7-a8de-14ca6bbd8c33 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:22.601207 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8b10e798-a50f-48b7-a8de-14ca6bbd8c33 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:22.601925 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8b10e798-a50f-48b7-a8de-14ca6bbd8c33 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:22.602591 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8b10e798-a50f-48b7-a8de-14ca6bbd8c33 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:23.887867 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-00050970-eda8-4363-84da-47a7470adc88 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:23.900853 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-00050970-eda8-4363-84da-47a7470adc88 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1321 microversion: 2.1 time: 1.746424 Aug 31 09:48:23.915074 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 37/66] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:22 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1321 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:23.929599 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-47fc3f8b-bb7e-4fad-a83c-5bebee069b41 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:23.935530 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-47fc3f8b-bb7e-4fad-a83c-5bebee069b41 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:23.960927 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-47fc3f8b-bb7e-4fad-a83c-5bebee069b41 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:23.965925 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-47fc3f8b-bb7e-4fad-a83c-5bebee069b41 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:23.968047 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-47fc3f8b-bb7e-4fad-a83c-5bebee069b41 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:23.971113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-47fc3f8b-bb7e-4fad-a83c-5bebee069b41 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:23.974684 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-47fc3f8b-bb7e-4fad-a83c-5bebee069b41 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:23.983949 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-47fc3f8b-bb7e-4fad-a83c-5bebee069b41 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:24.246778 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-8b10e798-a50f-48b7-a8de-14ca6bbd8c33 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:24.277094 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-8b10e798-a50f-48b7-a8de-14ca6bbd8c33 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1315 microversion: 2.1 time: 1.721325 Aug 31 09:48:24.284254 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 30/67] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:22 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1315 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:24.321348 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-47fc3f8b-bb7e-4fad-a83c-5bebee069b41 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:24.340755 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-47fc3f8b-bb7e-4fad-a83c-5bebee069b41 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1295 microversion: 2.1 time: 0.424264 Aug 31 09:48:24.343849 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 38/68] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:23 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1295 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:24.931355 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-f5f49e09-e636-4590-b010-a8f6fb517458 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:24.932122 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-f5f49e09-e636-4590-b010-a8f6fb517458 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:24.969467 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f5f49e09-e636-4590-b010-a8f6fb517458 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:24.969943 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f5f49e09-e636-4590-b010-a8f6fb517458 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:24.971111 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f5f49e09-e636-4590-b010-a8f6fb517458 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:24.971111 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f5f49e09-e636-4590-b010-a8f6fb517458 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:24.971530 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f5f49e09-e636-4590-b010-a8f6fb517458 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:24.975228 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f5f49e09-e636-4590-b010-a8f6fb517458 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:25.311109 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-6acccab3-8a54-4029-944f-437d999aeb5e tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:25.312831 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-6acccab3-8a54-4029-944f-437d999aeb5e tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:25.335025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6acccab3-8a54-4029-944f-437d999aeb5e tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:25.340413 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6acccab3-8a54-4029-944f-437d999aeb5e tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:25.342178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6acccab3-8a54-4029-944f-437d999aeb5e tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:25.344402 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6acccab3-8a54-4029-944f-437d999aeb5e tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:25.345675 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6acccab3-8a54-4029-944f-437d999aeb5e tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:25.347561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6acccab3-8a54-4029-944f-437d999aeb5e tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:26.359407 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=2 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:26.758657 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-f5f49e09-e636-4590-b010-a8f6fb517458 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:26.762061 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=67 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:26.797597 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-f5f49e09-e636-4590-b010-a8f6fb517458 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1321 microversion: 2.1 time: 1.866342 Aug 31 09:48:26.800113 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 31/69] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:24 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1321 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:26.819124 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-97214779-cecf-47cf-bec5-ea4f6836fa50 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:26.822474 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-97214779-cecf-47cf-bec5-ea4f6836fa50 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:26.840215 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-6acccab3-8a54-4029-944f-437d999aeb5e tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:26.846204 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=7 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:26.855952 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-6acccab3-8a54-4029-944f-437d999aeb5e tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1315 microversion: 2.1 time: 1.548323 Aug 31 09:48:26.869732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-97214779-cecf-47cf-bec5-ea4f6836fa50 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:26.869732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-97214779-cecf-47cf-bec5-ea4f6836fa50 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:26.869732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-97214779-cecf-47cf-bec5-ea4f6836fa50 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:26.872647 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-97214779-cecf-47cf-bec5-ea4f6836fa50 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:26.873796 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-97214779-cecf-47cf-bec5-ea4f6836fa50 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:26.874302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 39/70] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:25 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1315 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:48:26.875010 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-97214779-cecf-47cf-bec5-ea4f6836fa50 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:26.883065 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-49ba0f12-1857-48f7-87d0-634d779db625 req-46b6e690-b886-4d6c-832a-753591bf1450 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2dd468e-d0ef-4e78-be7f-9756e469206d", "tag": "b3ab5cef-31da-4563-8e4d-463a5b47cb88"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:26.906029 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=18 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:26.920657 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-49ba0f12-1857-48f7-87d0-634d779db625 req-46b6e690-b886-4d6c-832a-753591bf1450 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:26.923627 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-49ba0f12-1857-48f7-87d0-634d779db625 req-46b6e690-b886-4d6c-832a-753591bf1450 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:26.924437 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-49ba0f12-1857-48f7-87d0-634d779db625 req-46b6e690-b886-4d6c-832a-753591bf1450 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:27.016622 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-49ba0f12-1857-48f7-87d0-634d779db625 req-46b6e690-b886-4d6c-832a-753591bf1450 service nova] Creating event network-changed:b3ab5cef-31da-4563-8e4d-463a5b47cb88 for instance d2dd468e-d0ef-4e78-be7f-9756e469206d on hv-cinder-84496 Aug 31 09:48:27.018199 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-49ba0f12-1857-48f7-87d0-634d779db625 req-46b6e690-b886-4d6c-832a-753591bf1450 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127170) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 09:48:27.019055 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-49ba0f12-1857-48f7-87d0-634d779db625 req-46b6e690-b886-4d6c-832a-753591bf1450 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127170) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 09:48:27.021506 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7f41de01-5bc7-4d27-b773-7906cc64e2e5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:27.022386 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7f41de01-5bc7-4d27-b773-7906cc64e2e5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:27.023302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7f41de01-5bc7-4d27-b773-7906cc64e2e5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:27.024942 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7f41de01-5bc7-4d27-b773-7906cc64e2e5 None None] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:27.032264 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7f41de01-5bc7-4d27-b773-7906cc64e2e5 None None] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:27.034323 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7f41de01-5bc7-4d27-b773-7906cc64e2e5 None None] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:27.059093 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.compute.rpcapi [None req-7f41de01-5bc7-4d27-b773-7906cc64e2e5 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 09:48:27.060768 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7f41de01-5bc7-4d27-b773-7906cc64e2e5 None None] Releasing lock "compute-rpcapi-router" {{(pid=127170) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 09:48:27.108993 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-7f41de01-5bc7-4d27-b773-7906cc64e2e5 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.232508 Aug 31 09:48:27.111702 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 40/71] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:27.128789 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-fa8d7f6f-b306-435d-8e36-e51017c95eae tempest-VolumesTestJSON-1666634948 tempest-VolumesTestJSON-1666634948-project] Calling method '.version_select at 0x7f55081f3310>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:27.205164 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-fa8d7f6f-b306-435d-8e36-e51017c95eae tempest-VolumesTestJSON-1666634948 tempest-VolumesTestJSON-1666634948-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/09b552dd-c248-44e4-809e-9989eaa8d758" status: 200 len: 351 microversion: 2.1 time: 0.090314 Aug 31 09:48:27.206353 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 41/72] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 31 09:48:27 2022] GET /compute/v2.1/os-volumes/09b552dd-c248-44e4-809e-9989eaa8d758 => generated 351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:27.390415 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-97214779-cecf-47cf-bec5-ea4f6836fa50 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:27.416084 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-97214779-cecf-47cf-bec5-ea4f6836fa50 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1363 microversion: 2.1 time: 0.611428 Aug 31 09:48:27.438105 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 32/73] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:26 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1363 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:27.727533 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-2d1a7c39-ee86-4eca-81ad-bb0d41fc44f2 req-2ad7a6a0-fee4-406b-b59e-1d96e1439e69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74c8f70a-11b4-47de-9677-637917aa5115", "tag": "33cb2a1d-1582-4d9a-959c-ca576cea02dd"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:27.747139 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:27.759464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-2d1a7c39-ee86-4eca-81ad-bb0d41fc44f2 req-2ad7a6a0-fee4-406b-b59e-1d96e1439e69 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:27.760651 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-2d1a7c39-ee86-4eca-81ad-bb0d41fc44f2 req-2ad7a6a0-fee4-406b-b59e-1d96e1439e69 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:27.760651 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-2d1a7c39-ee86-4eca-81ad-bb0d41fc44f2 req-2ad7a6a0-fee4-406b-b59e-1d96e1439e69 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:27.768137 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=57 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:27.806805 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-2d1a7c39-ee86-4eca-81ad-bb0d41fc44f2 req-2ad7a6a0-fee4-406b-b59e-1d96e1439e69 service nova] Creating event network-changed:33cb2a1d-1582-4d9a-959c-ca576cea02dd for instance 74c8f70a-11b4-47de-9677-637917aa5115 on hv-cinder-84496 Aug 31 09:48:27.814314 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-2d1a7c39-ee86-4eca-81ad-bb0d41fc44f2 req-2ad7a6a0-fee4-406b-b59e-1d96e1439e69 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.605489 Aug 31 09:48:27.815467 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 42/74] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:27.839085 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-4dcca0e8-274f-4525-b7d4-56e3429ff44b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:27.840702 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-4dcca0e8-274f-4525-b7d4-56e3429ff44b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:27.855453 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4dcca0e8-274f-4525-b7d4-56e3429ff44b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:27.856345 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4dcca0e8-274f-4525-b7d4-56e3429ff44b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:27.856955 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4dcca0e8-274f-4525-b7d4-56e3429ff44b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:27.859920 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4dcca0e8-274f-4525-b7d4-56e3429ff44b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:27.862140 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4dcca0e8-274f-4525-b7d4-56e3429ff44b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:27.862786 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4dcca0e8-274f-4525-b7d4-56e3429ff44b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:27.885635 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-3e725143-4952-4338-b3d1-05112474627d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:27.886560 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-3e725143-4952-4338-b3d1-05112474627d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:27.915600 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3e725143-4952-4338-b3d1-05112474627d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:27.917632 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3e725143-4952-4338-b3d1-05112474627d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:27.921449 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3e725143-4952-4338-b3d1-05112474627d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:27.924494 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3e725143-4952-4338-b3d1-05112474627d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:27.926972 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3e725143-4952-4338-b3d1-05112474627d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:27.928710 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3e725143-4952-4338-b3d1-05112474627d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:28.359724 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=2 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:29.100374 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-4dcca0e8-274f-4525-b7d4-56e3429ff44b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:29.121892 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-4dcca0e8-274f-4525-b7d4-56e3429ff44b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1321 microversion: 2.1 time: 1.287980 Aug 31 09:48:29.123365 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 33/75] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:27 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1321 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:29.143549 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-cf39e6d8-d446-4a90-b01f-186b84ab4c65 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:29.149357 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-cf39e6d8-d446-4a90-b01f-186b84ab4c65 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:29.169935 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cf39e6d8-d446-4a90-b01f-186b84ab4c65 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:29.173669 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cf39e6d8-d446-4a90-b01f-186b84ab4c65 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:29.177635 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cf39e6d8-d446-4a90-b01f-186b84ab4c65 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:29.182919 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cf39e6d8-d446-4a90-b01f-186b84ab4c65 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:29.184797 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cf39e6d8-d446-4a90-b01f-186b84ab4c65 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:29.189303 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cf39e6d8-d446-4a90-b01f-186b84ab4c65 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:29.234263 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-3e725143-4952-4338-b3d1-05112474627d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:29.251057 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-3e725143-4952-4338-b3d1-05112474627d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1315 microversion: 2.1 time: 1.371934 Aug 31 09:48:29.253335 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 43/76] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:27 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1315 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:29.735364 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-cf39e6d8-d446-4a90-b01f-186b84ab4c65 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:29.753125 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-cf39e6d8-d446-4a90-b01f-186b84ab4c65 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1363 microversion: 2.1 time: 0.621336 Aug 31 09:48:29.755216 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 34/77] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:29 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1363 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:30.173932 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-aa235331-f26e-4329-8509-1c9b2245171a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:30.175014 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-aa235331-f26e-4329-8509-1c9b2245171a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:30.203386 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-aa235331-f26e-4329-8509-1c9b2245171a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:30.208600 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-aa235331-f26e-4329-8509-1c9b2245171a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:30.209265 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-aa235331-f26e-4329-8509-1c9b2245171a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:30.212547 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-aa235331-f26e-4329-8509-1c9b2245171a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:30.215341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-aa235331-f26e-4329-8509-1c9b2245171a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:30.218768 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-aa235331-f26e-4329-8509-1c9b2245171a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:30.299269 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-e29c2732-105d-45b5-879c-a8a6f6f063a5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:30.302357 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-e29c2732-105d-45b5-879c-a8a6f6f063a5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:30.317853 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e29c2732-105d-45b5-879c-a8a6f6f063a5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:30.319266 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e29c2732-105d-45b5-879c-a8a6f6f063a5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:30.320352 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e29c2732-105d-45b5-879c-a8a6f6f063a5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:30.324002 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e29c2732-105d-45b5-879c-a8a6f6f063a5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:30.325082 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e29c2732-105d-45b5-879c-a8a6f6f063a5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:30.326725 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e29c2732-105d-45b5-879c-a8a6f6f063a5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:30.974217 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-e29c2732-105d-45b5-879c-a8a6f6f063a5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:30.990787 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-aa235331-f26e-4329-8509-1c9b2245171a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:30.992316 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-e29c2732-105d-45b5-879c-a8a6f6f063a5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1315 microversion: 2.1 time: 0.704605 Aug 31 09:48:31.009713 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-aa235331-f26e-4329-8509-1c9b2245171a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1321 microversion: 2.1 time: 0.842615 Aug 31 09:48:31.009713 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 44/78] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:30 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1321 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:31.010601 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 35/79] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:30 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1315 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:31.015793 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-e3939a95-3ff5-4cf8-9370-fc93a80b642c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:31.016476 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-e3939a95-3ff5-4cf8-9370-fc93a80b642c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:31.028342 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e3939a95-3ff5-4cf8-9370-fc93a80b642c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:31.028813 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-78772aac-4242-4a0b-9bcd-ef69ae64c259 tempest-VolumesTestJSON-1666634948 tempest-VolumesTestJSON-1666634948-project] Calling method '.version_select at 0x7f55081f3790>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:31.028941 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e3939a95-3ff5-4cf8-9370-fc93a80b642c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:31.029263 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e3939a95-3ff5-4cf8-9370-fc93a80b642c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:31.030058 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e3939a95-3ff5-4cf8-9370-fc93a80b642c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:31.030518 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e3939a95-3ff5-4cf8-9370-fc93a80b642c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:31.030943 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e3939a95-3ff5-4cf8-9370-fc93a80b642c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:31.144248 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-78772aac-4242-4a0b-9bcd-ef69ae64c259 tempest-VolumesTestJSON-1666634948 tempest-VolumesTestJSON-1666634948-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/16a95f9b-67d5-4e1d-b4d9-8d6df7675bb1" status: 200 len: 350 microversion: 2.1 time: 0.133462 Aug 31 09:48:31.155233 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 45/80] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 31 09:48:31 2022] GET /compute/v2.1/os-volumes/16a95f9b-67d5-4e1d-b4d9-8d6df7675bb1 => generated 350 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:31.155233 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-f4fd1454-b43c-4003-91ff-72a0965a18b7 req-15cbf6de-1129-4d76-b0e5-c370cd17cfc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e598a8ab-5332-4c3c-8f72-098d0ac6a3c8", "tag": "cae2bef1-d3f5-4bd0-b345-99fbc7e354b9"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:31.178389 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-f4fd1454-b43c-4003-91ff-72a0965a18b7 req-15cbf6de-1129-4d76-b0e5-c370cd17cfc0 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:31.183772 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-f4fd1454-b43c-4003-91ff-72a0965a18b7 req-15cbf6de-1129-4d76-b0e5-c370cd17cfc0 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:31.184290 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-f4fd1454-b43c-4003-91ff-72a0965a18b7 req-15cbf6de-1129-4d76-b0e5-c370cd17cfc0 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:31.216034 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-f4fd1454-b43c-4003-91ff-72a0965a18b7 req-15cbf6de-1129-4d76-b0e5-c370cd17cfc0 service nova] Creating event network-changed:cae2bef1-d3f5-4bd0-b345-99fbc7e354b9 for instance e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 on hv-cinder-84496 Aug 31 09:48:31.229604 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-f4fd1454-b43c-4003-91ff-72a0965a18b7 req-15cbf6de-1129-4d76-b0e5-c370cd17cfc0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081403 Aug 31 09:48:31.235117 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-e3939a95-3ff5-4cf8-9370-fc93a80b642c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:31.236554 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 46/81] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:31.249809 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-e3939a95-3ff5-4cf8-9370-fc93a80b642c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1363 microversion: 2.1 time: 0.237595 Aug 31 09:48:31.250716 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 36/82] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:31 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:32.040254 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-3a11f8df-3cdb-4f3c-b0af-a731a9cf72d1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:32.043908 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-3a11f8df-3cdb-4f3c-b0af-a731a9cf72d1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:32.055639 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-397e53ce-2852-4f5e-b0a3-16080cfd161d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:32.060956 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-397e53ce-2852-4f5e-b0a3-16080cfd161d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:32.065371 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3a11f8df-3cdb-4f3c-b0af-a731a9cf72d1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:32.066631 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3a11f8df-3cdb-4f3c-b0af-a731a9cf72d1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:32.067572 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3a11f8df-3cdb-4f3c-b0af-a731a9cf72d1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:32.068758 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3a11f8df-3cdb-4f3c-b0af-a731a9cf72d1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:32.069849 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3a11f8df-3cdb-4f3c-b0af-a731a9cf72d1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:32.070576 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3a11f8df-3cdb-4f3c-b0af-a731a9cf72d1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:32.090587 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-397e53ce-2852-4f5e-b0a3-16080cfd161d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:32.092254 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-397e53ce-2852-4f5e-b0a3-16080cfd161d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:32.093119 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-397e53ce-2852-4f5e-b0a3-16080cfd161d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:32.098552 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-397e53ce-2852-4f5e-b0a3-16080cfd161d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:32.102095 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-397e53ce-2852-4f5e-b0a3-16080cfd161d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:32.102959 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-397e53ce-2852-4f5e-b0a3-16080cfd161d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:32.445574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-3a11f8df-3cdb-4f3c-b0af-a731a9cf72d1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:32.462023 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-3a11f8df-3cdb-4f3c-b0af-a731a9cf72d1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1315 microversion: 2.1 time: 0.431841 Aug 31 09:48:32.463557 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 47/83] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:32 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:32.480961 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-397e53ce-2852-4f5e-b0a3-16080cfd161d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:32.492599 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a6cd737d-f21b-4db6-897a-8796492634f5 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:32.493098 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-a6cd737d-f21b-4db6-897a-8796492634f5 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:32.496374 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-397e53ce-2852-4f5e-b0a3-16080cfd161d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1321 microversion: 2.1 time: 0.450237 Aug 31 09:48:32.497980 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 37/84] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:32 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1321 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:32.501050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a6cd737d-f21b-4db6-897a-8796492634f5 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:32.501827 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a6cd737d-f21b-4db6-897a-8796492634f5 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:32.503015 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a6cd737d-f21b-4db6-897a-8796492634f5 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:32.504649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a6cd737d-f21b-4db6-897a-8796492634f5 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:32.506038 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a6cd737d-f21b-4db6-897a-8796492634f5 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:32.506687 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a6cd737d-f21b-4db6-897a-8796492634f5 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:32.761210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-a6cd737d-f21b-4db6-897a-8796492634f5 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:32.777300 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a6cd737d-f21b-4db6-897a-8796492634f5 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1363 microversion: 2.1 time: 0.311450 Aug 31 09:48:32.778980 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 48/85] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:32 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1363 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:33.508611 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-22829bba-c67c-45e4-9af4-e01cf51fa4ef tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:33.509809 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-22829bba-c67c-45e4-9af4-e01cf51fa4ef tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:33.511679 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=2 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:33.518644 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-22829bba-c67c-45e4-9af4-e01cf51fa4ef tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:33.521064 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-22829bba-c67c-45e4-9af4-e01cf51fa4ef tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:33.521064 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-22829bba-c67c-45e4-9af4-e01cf51fa4ef tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:33.521606 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-22829bba-c67c-45e4-9af4-e01cf51fa4ef tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:33.521764 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-22829bba-c67c-45e4-9af4-e01cf51fa4ef tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:33.522151 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-22829bba-c67c-45e4-9af4-e01cf51fa4ef tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:33.534256 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-2796bdef-a031-4fa2-aa03-e558f28d540b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:33.536794 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-2796bdef-a031-4fa2-aa03-e558f28d540b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:33.549173 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2796bdef-a031-4fa2-aa03-e558f28d540b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:33.550578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2796bdef-a031-4fa2-aa03-e558f28d540b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:33.554012 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2796bdef-a031-4fa2-aa03-e558f28d540b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:33.556009 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2796bdef-a031-4fa2-aa03-e558f28d540b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:33.557210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2796bdef-a031-4fa2-aa03-e558f28d540b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:33.558777 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2796bdef-a031-4fa2-aa03-e558f28d540b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:33.790073 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-22829bba-c67c-45e4-9af4-e01cf51fa4ef tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:33.810039 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-22829bba-c67c-45e4-9af4-e01cf51fa4ef tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1315 microversion: 2.1 time: 0.304697 Aug 31 09:48:33.813042 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 38/86] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:33 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:33.832913 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-2796bdef-a031-4fa2-aa03-e558f28d540b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:33.833473 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9287584a-8d95-4dc1-86a0-fde40c4f5bd3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:33.834413 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-9287584a-8d95-4dc1-86a0-fde40c4f5bd3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:33.842508 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9287584a-8d95-4dc1-86a0-fde40c4f5bd3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:33.843380 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9287584a-8d95-4dc1-86a0-fde40c4f5bd3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:33.844038 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9287584a-8d95-4dc1-86a0-fde40c4f5bd3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:33.845772 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9287584a-8d95-4dc1-86a0-fde40c4f5bd3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:33.846585 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9287584a-8d95-4dc1-86a0-fde40c4f5bd3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:33.847269 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9287584a-8d95-4dc1-86a0-fde40c4f5bd3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:33.854615 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-2796bdef-a031-4fa2-aa03-e558f28d540b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1321 microversion: 2.1 time: 0.327622 Aug 31 09:48:33.855165 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 49/87] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:33 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1321 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:34.101884 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-9287584a-8d95-4dc1-86a0-fde40c4f5bd3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:34.117144 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-9287584a-8d95-4dc1-86a0-fde40c4f5bd3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1363 microversion: 2.1 time: 0.301418 Aug 31 09:48:34.118683 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 39/88] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:33 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1363 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:34.836574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-85128981-0bd1-4893-87d7-cac8ab2f5ae7 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:34.837647 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-85128981-0bd1-4893-87d7-cac8ab2f5ae7 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:34.848581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-85128981-0bd1-4893-87d7-cac8ab2f5ae7 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:34.849777 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-85128981-0bd1-4893-87d7-cac8ab2f5ae7 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:34.850752 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-85128981-0bd1-4893-87d7-cac8ab2f5ae7 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:34.852848 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-85128981-0bd1-4893-87d7-cac8ab2f5ae7 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:34.853959 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-85128981-0bd1-4893-87d7-cac8ab2f5ae7 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:34.854944 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-85128981-0bd1-4893-87d7-cac8ab2f5ae7 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:34.880059 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-24b135f9-fc67-4f15-a8e9-a973eeb177e7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:34.880797 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-24b135f9-fc67-4f15-a8e9-a973eeb177e7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:34.893979 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-24b135f9-fc67-4f15-a8e9-a973eeb177e7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:34.895931 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-24b135f9-fc67-4f15-a8e9-a973eeb177e7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:34.896815 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-24b135f9-fc67-4f15-a8e9-a973eeb177e7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:34.898651 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-24b135f9-fc67-4f15-a8e9-a973eeb177e7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:34.899656 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-24b135f9-fc67-4f15-a8e9-a973eeb177e7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:34.900816 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-24b135f9-fc67-4f15-a8e9-a973eeb177e7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:35.163734 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-85128981-0bd1-4893-87d7-cac8ab2f5ae7 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:35.168337 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-24b135f9-fc67-4f15-a8e9-a973eeb177e7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:35.179398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-24b135f9-fc67-4f15-a8e9-a973eeb177e7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1321 microversion: 2.1 time: 0.305970 Aug 31 09:48:35.179750 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-85128981-0bd1-4893-87d7-cac8ab2f5ae7 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1315 microversion: 2.1 time: 0.347885 Aug 31 09:48:35.180626 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 40/89] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:34 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:35.193561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 50/90] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:34 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:35.198059 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-a8ed3246-781e-4a04-9fce-b51a23e9c8d7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:35.199107 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-a8ed3246-781e-4a04-9fce-b51a23e9c8d7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:35.219466 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a8ed3246-781e-4a04-9fce-b51a23e9c8d7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:35.223652 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a8ed3246-781e-4a04-9fce-b51a23e9c8d7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:35.225006 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a8ed3246-781e-4a04-9fce-b51a23e9c8d7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:35.226190 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a8ed3246-781e-4a04-9fce-b51a23e9c8d7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:35.227181 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a8ed3246-781e-4a04-9fce-b51a23e9c8d7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:35.228250 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a8ed3246-781e-4a04-9fce-b51a23e9c8d7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:35.354713 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-4547146f-ce32-492e-ae50-57abc9329ed4 tempest-VolumesTestJSON-1666634948 tempest-VolumesTestJSON-1666634948-project] Calling method '.version_select at 0x7f55081f3700>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:35.554230 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-4547146f-ce32-492e-ae50-57abc9329ed4 tempest-VolumesTestJSON-1666634948 tempest-VolumesTestJSON-1666634948-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/426d0b30-d576-4302-b0b7-8d10235202ad" status: 200 len: 350 microversion: 2.1 time: 0.204001 Aug 31 09:48:35.555155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 51/91] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 31 09:48:35 2022] GET /compute/v2.1/os-volumes/426d0b30-d576-4302-b0b7-8d10235202ad => generated 350 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:35.576706 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a16e8353-0f44-4363-b7a9-b8155698f809 tempest-VolumesTestJSON-1666634948 tempest-VolumesTestJSON-1666634948-project] Calling method '.version_select at 0x7f55081cf940>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:35.690725 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a16e8353-0f44-4363-b7a9-b8155698f809 tempest-VolumesTestJSON-1666634948 tempest-VolumesTestJSON-1666634948-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.118335 Aug 31 09:48:35.691695 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 52/92] 10.222.0.13 () {58 vars in 1134 bytes} [Wed Aug 31 09:48:35 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:48:35.721371 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-605d84d5-6372-497f-9183-430d543246d8 tempest-VolumesTestJSON-1666634948 tempest-VolumesTestJSON-1666634948-project] Calling method '.version_select at 0x7f55081f2160>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:35.755066 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-a8ed3246-781e-4a04-9fce-b51a23e9c8d7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:35.769224 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-a8ed3246-781e-4a04-9fce-b51a23e9c8d7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1363 microversion: 2.1 time: 0.586724 Aug 31 09:48:35.770675 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 41/93] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:35 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1363 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:35.853152 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-605d84d5-6372-497f-9183-430d543246d8 tempest-VolumesTestJSON-1666634948 tempest-VolumesTestJSON-1666634948-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.147825 Aug 31 09:48:35.854002 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 53/94] 10.222.0.13 () {58 vars in 1149 bytes} [Wed Aug 31 09:48:35 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:35.869902 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-dcffb46c-07da-4ebd-b697-e4a31921ed64 tempest-VolumesTestJSON-1666634948 tempest-VolumesTestJSON-1666634948-project] Calling method '.version_select at 0x7f55081f4940>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:35.993273 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-dcffb46c-07da-4ebd-b697-e4a31921ed64 tempest-VolumesTestJSON-1666634948 tempest-VolumesTestJSON-1666634948-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.127692 Aug 31 09:48:35.995083 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 42/95] 10.222.0.13 () {58 vars in 1134 bytes} [Wed Aug 31 09:48:35 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:36.018679 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-32afb2fa-a9bb-4c34-88bf-83e99737b410 tempest-VolumesTestJSON-1666634948 tempest-VolumesTestJSON-1666634948-project] Calling method '.version_select at 0x7f55081f2ca0>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:36.215914 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-32afb2fa-a9bb-4c34-88bf-83e99737b410 tempest-VolumesTestJSON-1666634948 tempest-VolumesTestJSON-1666634948-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.203910 Aug 31 09:48:36.221164 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 54/96] 10.222.0.13 () {58 vars in 1167 bytes} [Wed Aug 31 09:48:36 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:36.232112 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-786275a4-943f-4d57-9b43-f26cfbfa8bea tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:36.233579 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-786275a4-943f-4d57-9b43-f26cfbfa8bea tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:36.234565 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-0af31d6a-1166-4e65-b8dd-a393dcf9c922 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:36.235591 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-0af31d6a-1166-4e65-b8dd-a393dcf9c922 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:36.247735 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-786275a4-943f-4d57-9b43-f26cfbfa8bea tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:36.248579 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-786275a4-943f-4d57-9b43-f26cfbfa8bea tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:36.249616 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-786275a4-943f-4d57-9b43-f26cfbfa8bea tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:36.249827 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0af31d6a-1166-4e65-b8dd-a393dcf9c922 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:36.250892 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-786275a4-943f-4d57-9b43-f26cfbfa8bea tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:36.251109 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0af31d6a-1166-4e65-b8dd-a393dcf9c922 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:36.252036 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-786275a4-943f-4d57-9b43-f26cfbfa8bea tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:36.252241 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0af31d6a-1166-4e65-b8dd-a393dcf9c922 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:36.252775 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-786275a4-943f-4d57-9b43-f26cfbfa8bea tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:36.254680 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0af31d6a-1166-4e65-b8dd-a393dcf9c922 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:36.255394 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0af31d6a-1166-4e65-b8dd-a393dcf9c922 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:36.256289 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0af31d6a-1166-4e65-b8dd-a393dcf9c922 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:36.509443 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-786275a4-943f-4d57-9b43-f26cfbfa8bea tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:36.531698 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-786275a4-943f-4d57-9b43-f26cfbfa8bea tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1315 microversion: 2.1 time: 0.314542 Aug 31 09:48:36.532998 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 43/97] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:36 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:48:36.542946 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-65554593-187b-4f02-8e18-ea05bfafe430 tempest-VolumesTestJSON-1666634948 tempest-VolumesTestJSON-1666634948-project] Calling method '.version_select at 0x7f550824b9d0>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:36.575502 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-0af31d6a-1166-4e65-b8dd-a393dcf9c922 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:36.591719 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-0af31d6a-1166-4e65-b8dd-a393dcf9c922 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1321 microversion: 2.1 time: 0.371781 Aug 31 09:48:36.593135 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 55/98] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:36 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1321 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:36.713714 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-65554593-187b-4f02-8e18-ea05bfafe430 tempest-VolumesTestJSON-1666634948 tempest-VolumesTestJSON-1666634948-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.178663 Aug 31 09:48:36.714297 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 44/99] 10.222.0.13 () {58 vars in 1170 bytes} [Wed Aug 31 09:48:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:36.735921 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-1cdf10c1-5407-44e7-80df-d7cc716c1377 tempest-VolumesTestJSON-1666634948 tempest-VolumesTestJSON-1666634948-project] Calling method '.version_select at 0x7f55081f3700>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:36.791897 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9814ab22-5a9c-4815-8b91-23b2e5851219 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:36.792291 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-9814ab22-5a9c-4815-8b91-23b2e5851219 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:36.800551 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9814ab22-5a9c-4815-8b91-23b2e5851219 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:36.801424 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9814ab22-5a9c-4815-8b91-23b2e5851219 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:36.801958 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9814ab22-5a9c-4815-8b91-23b2e5851219 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:36.802783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9814ab22-5a9c-4815-8b91-23b2e5851219 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:36.803321 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9814ab22-5a9c-4815-8b91-23b2e5851219 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:36.803832 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9814ab22-5a9c-4815-8b91-23b2e5851219 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:36.873627 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-1cdf10c1-5407-44e7-80df-d7cc716c1377 tempest-VolumesTestJSON-1666634948 tempest-VolumesTestJSON-1666634948-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.144969 Aug 31 09:48:36.874509 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 56/100] 10.222.0.13 () {58 vars in 1155 bytes} [Wed Aug 31 09:48:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:36.892298 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-2d12a015-f8e6-4ba2-82e5-6e48373341f1 tempest-VolumesTestJSON-1666634948 tempest-VolumesTestJSON-1666634948-project] Calling method '.version_select at 0x7f55081f23a0>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:37.019021 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-2d12a015-f8e6-4ba2-82e5-6e48373341f1 tempest-VolumesTestJSON-1666634948 tempest-VolumesTestJSON-1666634948-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.132286 Aug 31 09:48:37.020139 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 57/101] 10.222.0.13 () {58 vars in 1188 bytes} [Wed Aug 31 09:48:36 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:48:37.040696 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-d828d748-4bc6-47d4-b687-1d21209810d6 tempest-VolumesTestJSON-1666634948 tempest-VolumesTestJSON-1666634948-project] Calling method '.version_select at 0x7f55081cfee0>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:37.044504 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-9814ab22-5a9c-4815-8b91-23b2e5851219 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:37.057047 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-9814ab22-5a9c-4815-8b91-23b2e5851219 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1363 microversion: 2.1 time: 0.268903 Aug 31 09:48:37.058608 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 45/102] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:36 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:48:37.060469 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=2 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:37.212914 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-d828d748-4bc6-47d4-b687-1d21209810d6 tempest-VolumesTestJSON-1666634948 tempest-VolumesTestJSON-1666634948-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.181724 Aug 31 09:48:37.213896 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 58/103] 10.222.0.13 () {58 vars in 1155 bytes} [Wed Aug 31 09:48:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:48:37.583555 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-45cd533b-e6ae-4c00-a7a4-8326b07d89c9 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:37.585159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-45cd533b-e6ae-4c00-a7a4-8326b07d89c9 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:37.608786 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-45cd533b-e6ae-4c00-a7a4-8326b07d89c9 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:37.615460 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-45cd533b-e6ae-4c00-a7a4-8326b07d89c9 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:37.617930 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-45cd533b-e6ae-4c00-a7a4-8326b07d89c9 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:37.621642 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-45cd533b-e6ae-4c00-a7a4-8326b07d89c9 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:37.624091 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-45cd533b-e6ae-4c00-a7a4-8326b07d89c9 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:37.625251 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-45cd533b-e6ae-4c00-a7a4-8326b07d89c9 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:37.632751 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-3bdfaa4f-41da-4497-88a6-400860b69306 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:37.633593 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-3bdfaa4f-41da-4497-88a6-400860b69306 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:37.674595 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3bdfaa4f-41da-4497-88a6-400860b69306 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:37.675515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3bdfaa4f-41da-4497-88a6-400860b69306 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:37.677052 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3bdfaa4f-41da-4497-88a6-400860b69306 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:37.681198 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3bdfaa4f-41da-4497-88a6-400860b69306 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:37.682240 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3bdfaa4f-41da-4497-88a6-400860b69306 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:37.683210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3bdfaa4f-41da-4497-88a6-400860b69306 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:38.117498 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-45cd533b-e6ae-4c00-a7a4-8326b07d89c9 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:38.174431 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-45cd533b-e6ae-4c00-a7a4-8326b07d89c9 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1315 microversion: 2.1 time: 0.588216 Aug 31 09:48:38.182534 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 46/104] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:37 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1315 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:38.212520 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-43855e2e-4852-47cd-9794-956953bc7dbf tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:38.215740 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-43855e2e-4852-47cd-9794-956953bc7dbf tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:38.248519 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-43855e2e-4852-47cd-9794-956953bc7dbf tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:38.250710 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-43855e2e-4852-47cd-9794-956953bc7dbf tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:38.253198 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-43855e2e-4852-47cd-9794-956953bc7dbf tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:38.260803 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-43855e2e-4852-47cd-9794-956953bc7dbf tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:38.265303 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-43855e2e-4852-47cd-9794-956953bc7dbf tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:38.270791 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-43855e2e-4852-47cd-9794-956953bc7dbf tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:38.442909 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-3bdfaa4f-41da-4497-88a6-400860b69306 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:38.474727 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-3bdfaa4f-41da-4497-88a6-400860b69306 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1321 microversion: 2.1 time: 0.845081 Aug 31 09:48:38.477671 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 59/105] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:37 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1321 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:39.232530 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-ad3e3df1-a1b5-41b2-8b39-ce22218ffdc0 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:39.233923 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-ad3e3df1-a1b5-41b2-8b39-ce22218ffdc0 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:39.291162 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ad3e3df1-a1b5-41b2-8b39-ce22218ffdc0 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:39.299220 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ad3e3df1-a1b5-41b2-8b39-ce22218ffdc0 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:39.306600 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ad3e3df1-a1b5-41b2-8b39-ce22218ffdc0 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:39.315720 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ad3e3df1-a1b5-41b2-8b39-ce22218ffdc0 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:39.327781 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ad3e3df1-a1b5-41b2-8b39-ce22218ffdc0 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:39.336522 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ad3e3df1-a1b5-41b2-8b39-ce22218ffdc0 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:39.688371 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-43855e2e-4852-47cd-9794-956953bc7dbf tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:39.713152 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-43855e2e-4852-47cd-9794-956953bc7dbf tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1363 microversion: 2.1 time: 1.526022 Aug 31 09:48:39.714690 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 47/106] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:38 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1363 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:39.750386 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-cdfc6c20-0409-431d-89bf-bbb79b572299 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:39.754090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-cdfc6c20-0409-431d-89bf-bbb79b572299 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:39.789220 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cdfc6c20-0409-431d-89bf-bbb79b572299 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:39.790499 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cdfc6c20-0409-431d-89bf-bbb79b572299 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:39.791276 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cdfc6c20-0409-431d-89bf-bbb79b572299 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:39.792787 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cdfc6c20-0409-431d-89bf-bbb79b572299 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:39.793769 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cdfc6c20-0409-431d-89bf-bbb79b572299 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:39.794920 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cdfc6c20-0409-431d-89bf-bbb79b572299 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:39.961714 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-ad3e3df1-a1b5-41b2-8b39-ce22218ffdc0 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:39.970960 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-ad3e3df1-a1b5-41b2-8b39-ce22218ffdc0 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1315 microversion: 2.1 time: 0.756298 Aug 31 09:48:39.996423 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 60/107] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:39 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1315 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:40.381970 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-cdfc6c20-0409-431d-89bf-bbb79b572299 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:40.390785 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-cdfc6c20-0409-431d-89bf-bbb79b572299 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1321 microversion: 2.1 time: 0.673586 Aug 31 09:48:40.391397 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 48/108] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:39 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1321 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:40.484242 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-866a53ec-7b08-4e56-96f0-09c604cf1a4e req-d79c5991-d1f6-4693-8d99-f0c6bda20061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd0a166f-d662-4a72-8ea2-bfbbb02b2221", "name": "network-vif-plugged", "status": "completed", "tag": "dc0a1702-552b-409c-91a1-5a380acf6fea"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:40.522860 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-866a53ec-7b08-4e56-96f0-09c604cf1a4e req-d79c5991-d1f6-4693-8d99-f0c6bda20061 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:40.524131 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-866a53ec-7b08-4e56-96f0-09c604cf1a4e req-d79c5991-d1f6-4693-8d99-f0c6bda20061 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:40.524835 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-866a53ec-7b08-4e56-96f0-09c604cf1a4e req-d79c5991-d1f6-4693-8d99-f0c6bda20061 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:40.554367 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-866a53ec-7b08-4e56-96f0-09c604cf1a4e req-d79c5991-d1f6-4693-8d99-f0c6bda20061 service nova] Creating event network-vif-plugged:dc0a1702-552b-409c-91a1-5a380acf6fea for instance dd0a166f-d662-4a72-8ea2-bfbbb02b2221 on hv-cinder-84496 Aug 31 09:48:40.563328 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-866a53ec-7b08-4e56-96f0-09c604cf1a4e req-d79c5991-d1f6-4693-8d99-f0c6bda20061 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.249545 Aug 31 09:48:40.580481 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 61/109] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:48:40.754597 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-6fff54b0-9684-455a-a004-743607b652a3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:40.763888 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-6fff54b0-9684-455a-a004-743607b652a3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:40.783033 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6fff54b0-9684-455a-a004-743607b652a3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:40.784458 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6fff54b0-9684-455a-a004-743607b652a3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:40.786212 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6fff54b0-9684-455a-a004-743607b652a3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:40.788085 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6fff54b0-9684-455a-a004-743607b652a3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:40.789410 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6fff54b0-9684-455a-a004-743607b652a3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:40.790190 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6fff54b0-9684-455a-a004-743607b652a3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:41.001590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-28594a72-4be9-4d05-9efb-04cf6c6e24b5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:41.005708 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-28594a72-4be9-4d05-9efb-04cf6c6e24b5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:41.028654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-28594a72-4be9-4d05-9efb-04cf6c6e24b5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:41.029617 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-28594a72-4be9-4d05-9efb-04cf6c6e24b5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:41.030335 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-28594a72-4be9-4d05-9efb-04cf6c6e24b5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:41.034035 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-28594a72-4be9-4d05-9efb-04cf6c6e24b5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:41.036084 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-28594a72-4be9-4d05-9efb-04cf6c6e24b5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:41.036900 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-28594a72-4be9-4d05-9efb-04cf6c6e24b5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:41.302188 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-6fff54b0-9684-455a-a004-743607b652a3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:41.314751 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-6fff54b0-9684-455a-a004-743607b652a3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1363 microversion: 2.1 time: 0.569842 Aug 31 09:48:41.317710 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 49/110] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:40 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1363 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:41.444908 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-8c4a3a6f-169a-48b7-918c-ff20fe05ff78 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:41.446136 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-8c4a3a6f-169a-48b7-918c-ff20fe05ff78 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:41.455130 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-28594a72-4be9-4d05-9efb-04cf6c6e24b5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:41.463824 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8c4a3a6f-169a-48b7-918c-ff20fe05ff78 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:41.482347 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-28594a72-4be9-4d05-9efb-04cf6c6e24b5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1315 microversion: 2.1 time: 0.490807 Aug 31 09:48:41.483190 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8c4a3a6f-169a-48b7-918c-ff20fe05ff78 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:41.483985 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8c4a3a6f-169a-48b7-918c-ff20fe05ff78 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:41.490060 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8c4a3a6f-169a-48b7-918c-ff20fe05ff78 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:41.493309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8c4a3a6f-169a-48b7-918c-ff20fe05ff78 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:41.497547 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8c4a3a6f-169a-48b7-918c-ff20fe05ff78 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:41.500059 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 62/111] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:40 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:41.574338 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=100 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:41.783954 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-8c4a3a6f-169a-48b7-918c-ff20fe05ff78 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:41.795991 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-8c4a3a6f-169a-48b7-918c-ff20fe05ff78 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1321 microversion: 2.1 time: 0.362373 Aug 31 09:48:41.796852 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 50/112] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:41 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:42.371125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-54c91d54-695b-42d2-8848-9b9e901982b4 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:42.374828 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-54c91d54-695b-42d2-8848-9b9e901982b4 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:42.392715 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-54c91d54-695b-42d2-8848-9b9e901982b4 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:42.393705 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-54c91d54-695b-42d2-8848-9b9e901982b4 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:42.394442 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-54c91d54-695b-42d2-8848-9b9e901982b4 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:42.395451 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-54c91d54-695b-42d2-8848-9b9e901982b4 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:42.398455 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-54c91d54-695b-42d2-8848-9b9e901982b4 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:42.399214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-54c91d54-695b-42d2-8848-9b9e901982b4 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:42.505522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-1d3c77cd-4582-4b43-acef-5910e7802089 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:42.506148 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-1d3c77cd-4582-4b43-acef-5910e7802089 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:42.518400 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1d3c77cd-4582-4b43-acef-5910e7802089 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:42.520843 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1d3c77cd-4582-4b43-acef-5910e7802089 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:42.523452 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1d3c77cd-4582-4b43-acef-5910e7802089 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:42.525479 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1d3c77cd-4582-4b43-acef-5910e7802089 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:42.527346 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1d3c77cd-4582-4b43-acef-5910e7802089 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:42.528070 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1d3c77cd-4582-4b43-acef-5910e7802089 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:43.045851 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-1d3c77cd-4582-4b43-acef-5910e7802089 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:43.049842 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-54c91d54-695b-42d2-8848-9b9e901982b4 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:43.089035 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-54c91d54-695b-42d2-8848-9b9e901982b4 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1363 microversion: 2.1 time: 0.727044 Aug 31 09:48:43.096560 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-1d3c77cd-4582-4b43-acef-5910e7802089 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1315 microversion: 2.1 time: 0.594491 Aug 31 09:48:43.104345 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 51/114] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:42 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1315 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:43.104855 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 63/114] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:42 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1363 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:43.132166 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-eeb1a2b6-3b79-465a-b2d7-abd136ecea97 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:43.135788 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-eeb1a2b6-3b79-465a-b2d7-abd136ecea97 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:43.152256 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-eeb1a2b6-3b79-465a-b2d7-abd136ecea97 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:43.153140 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-eeb1a2b6-3b79-465a-b2d7-abd136ecea97 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:43.154279 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-eeb1a2b6-3b79-465a-b2d7-abd136ecea97 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:43.156791 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-eeb1a2b6-3b79-465a-b2d7-abd136ecea97 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:43.158614 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-eeb1a2b6-3b79-465a-b2d7-abd136ecea97 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:43.159498 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-eeb1a2b6-3b79-465a-b2d7-abd136ecea97 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:43.689009 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-eeb1a2b6-3b79-465a-b2d7-abd136ecea97 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:43.700416 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-eeb1a2b6-3b79-465a-b2d7-abd136ecea97 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1321 microversion: 2.1 time: 0.591632 Aug 31 09:48:43.701305 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 52/115] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:43 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1321 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:43.728720 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-2f10915d-74b7-49a7-99a2-e1b106f13ce4 req-e2496d86-6489-4bf9-8fa7-08cd15acf954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2dd468e-d0ef-4e78-be7f-9756e469206d", "name": "network-vif-plugged", "status": "completed", "tag": "b3ab5cef-31da-4563-8e4d-463a5b47cb88"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:43.760479 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-2f10915d-74b7-49a7-99a2-e1b106f13ce4 req-e2496d86-6489-4bf9-8fa7-08cd15acf954 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:43.763414 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-2f10915d-74b7-49a7-99a2-e1b106f13ce4 req-e2496d86-6489-4bf9-8fa7-08cd15acf954 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:43.764561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-2f10915d-74b7-49a7-99a2-e1b106f13ce4 req-e2496d86-6489-4bf9-8fa7-08cd15acf954 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:43.808924 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-2f10915d-74b7-49a7-99a2-e1b106f13ce4 req-e2496d86-6489-4bf9-8fa7-08cd15acf954 service nova] Creating event network-vif-plugged:b3ab5cef-31da-4563-8e4d-463a5b47cb88 for instance d2dd468e-d0ef-4e78-be7f-9756e469206d on hv-cinder-84496 Aug 31 09:48:43.825748 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-2f10915d-74b7-49a7-99a2-e1b106f13ce4 req-e2496d86-6489-4bf9-8fa7-08cd15acf954 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105577 Aug 31 09:48:43.827888 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 64/116] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:44.124680 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-3bbba104-89ce-49b0-9477-a7ae6acf8fca tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:44.127228 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-3bbba104-89ce-49b0-9477-a7ae6acf8fca tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:44.134663 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b09175d9-117c-440e-89af-a1f5a21f6e76 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:44.137657 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b09175d9-117c-440e-89af-a1f5a21f6e76 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:44.149914 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3bbba104-89ce-49b0-9477-a7ae6acf8fca tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:44.155436 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3bbba104-89ce-49b0-9477-a7ae6acf8fca tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:44.156130 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3bbba104-89ce-49b0-9477-a7ae6acf8fca tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:44.157124 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b09175d9-117c-440e-89af-a1f5a21f6e76 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:44.157582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3bbba104-89ce-49b0-9477-a7ae6acf8fca tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:44.158317 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b09175d9-117c-440e-89af-a1f5a21f6e76 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:44.160887 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b09175d9-117c-440e-89af-a1f5a21f6e76 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:44.161208 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3bbba104-89ce-49b0-9477-a7ae6acf8fca tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:44.161938 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3bbba104-89ce-49b0-9477-a7ae6acf8fca tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:44.162913 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b09175d9-117c-440e-89af-a1f5a21f6e76 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:44.167826 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b09175d9-117c-440e-89af-a1f5a21f6e76 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:44.168516 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b09175d9-117c-440e-89af-a1f5a21f6e76 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:44.836554 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b09175d9-117c-440e-89af-a1f5a21f6e76 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:44.865149 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b09175d9-117c-440e-89af-a1f5a21f6e76 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1363 microversion: 2.1 time: 0.730909 Aug 31 09:48:44.866735 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 65/117] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:44 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1363 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:44.875054 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-073fe052-7a65-4ed4-98e0-67600b85f732 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:44.875455 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-3bbba104-89ce-49b0-9477-a7ae6acf8fca tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:44.876980 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-073fe052-7a65-4ed4-98e0-67600b85f732 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:44.887302 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-3bbba104-89ce-49b0-9477-a7ae6acf8fca tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1315 microversion: 2.1 time: 0.766634 Aug 31 09:48:44.889043 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-073fe052-7a65-4ed4-98e0-67600b85f732 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:44.890024 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-073fe052-7a65-4ed4-98e0-67600b85f732 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:44.890917 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-073fe052-7a65-4ed4-98e0-67600b85f732 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:44.892357 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-073fe052-7a65-4ed4-98e0-67600b85f732 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:44.893366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-073fe052-7a65-4ed4-98e0-67600b85f732 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:44.894356 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-073fe052-7a65-4ed4-98e0-67600b85f732 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:44.898668 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 53/118] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:44 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1315 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:45.177295 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-073fe052-7a65-4ed4-98e0-67600b85f732 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:45.202646 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-073fe052-7a65-4ed4-98e0-67600b85f732 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1321 microversion: 2.1 time: 0.329211 Aug 31 09:48:45.202646 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 66/119] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:44 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1321 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:45.913784 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-56904367-8283-427b-8d88-7b5197caa187 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:45.915335 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-56904367-8283-427b-8d88-7b5197caa187 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:45.916449 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-f2882c55-cd54-452e-999f-ca9e6cb29d53 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:45.918932 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-f2882c55-cd54-452e-999f-ca9e6cb29d53 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:45.932385 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-56904367-8283-427b-8d88-7b5197caa187 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:45.932984 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-56904367-8283-427b-8d88-7b5197caa187 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:45.934793 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-56904367-8283-427b-8d88-7b5197caa187 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:45.936022 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-56904367-8283-427b-8d88-7b5197caa187 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:45.936512 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-56904367-8283-427b-8d88-7b5197caa187 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:45.936955 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-56904367-8283-427b-8d88-7b5197caa187 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:45.944966 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f2882c55-cd54-452e-999f-ca9e6cb29d53 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:45.946687 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f2882c55-cd54-452e-999f-ca9e6cb29d53 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:45.950275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f2882c55-cd54-452e-999f-ca9e6cb29d53 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:45.957359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f2882c55-cd54-452e-999f-ca9e6cb29d53 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:45.959859 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f2882c55-cd54-452e-999f-ca9e6cb29d53 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:45.961188 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f2882c55-cd54-452e-999f-ca9e6cb29d53 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:46.415902 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-56904367-8283-427b-8d88-7b5197caa187 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:46.440490 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-56904367-8283-427b-8d88-7b5197caa187 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1315 microversion: 2.1 time: 0.533136 Aug 31 09:48:46.443427 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 67/120] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:45 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1315 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:46.487146 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-96fe8f9a-fa82-4844-a91d-7d75974d4566 req-45a2126f-7b30-44b6-b7a5-58e6cc3e7d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74c8f70a-11b4-47de-9677-637917aa5115", "name": "network-vif-plugged", "status": "completed", "tag": "33cb2a1d-1582-4d9a-959c-ca576cea02dd"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:46.518492 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-f2882c55-cd54-452e-999f-ca9e6cb29d53 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:46.528170 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-96fe8f9a-fa82-4844-a91d-7d75974d4566 req-45a2126f-7b30-44b6-b7a5-58e6cc3e7d76 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:46.529299 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-96fe8f9a-fa82-4844-a91d-7d75974d4566 req-45a2126f-7b30-44b6-b7a5-58e6cc3e7d76 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:46.530285 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-96fe8f9a-fa82-4844-a91d-7d75974d4566 req-45a2126f-7b30-44b6-b7a5-58e6cc3e7d76 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:46.535360 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-f2882c55-cd54-452e-999f-ca9e6cb29d53 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1363 microversion: 2.1 time: 0.629895 Aug 31 09:48:46.560537 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 54/121] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:45 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1363 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:46.592560 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-96fe8f9a-fa82-4844-a91d-7d75974d4566 req-45a2126f-7b30-44b6-b7a5-58e6cc3e7d76 service nova] Creating event network-vif-plugged:33cb2a1d-1582-4d9a-959c-ca576cea02dd for instance 74c8f70a-11b4-47de-9677-637917aa5115 on hv-cinder-84496 Aug 31 09:48:46.598327 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-dccf79cd-fd54-498f-bd89-f46357a826ea tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:46.599524 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-dccf79cd-fd54-498f-bd89-f46357a826ea tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:46.616556 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-96fe8f9a-fa82-4844-a91d-7d75974d4566 req-45a2126f-7b30-44b6-b7a5-58e6cc3e7d76 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154140 Aug 31 09:48:46.618741 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dccf79cd-fd54-498f-bd89-f46357a826ea tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:46.620115 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dccf79cd-fd54-498f-bd89-f46357a826ea tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:46.620444 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 68/122] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:46.621801 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dccf79cd-fd54-498f-bd89-f46357a826ea tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:46.623428 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dccf79cd-fd54-498f-bd89-f46357a826ea tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:46.624348 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dccf79cd-fd54-498f-bd89-f46357a826ea tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:46.627907 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dccf79cd-fd54-498f-bd89-f46357a826ea tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:46.881108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-dccf79cd-fd54-498f-bd89-f46357a826ea tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:46.892373 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-dccf79cd-fd54-498f-bd89-f46357a826ea tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1321 microversion: 2.1 time: 0.329832 Aug 31 09:48:46.894602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 55/123] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:46 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1321 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:47.488608 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-30cead08-1dd5-46cb-b97a-16e5c7732939 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:47.495320 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-30cead08-1dd5-46cb-b97a-16e5c7732939 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:47.525043 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-30cead08-1dd5-46cb-b97a-16e5c7732939 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:47.525664 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-30cead08-1dd5-46cb-b97a-16e5c7732939 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:47.526163 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-30cead08-1dd5-46cb-b97a-16e5c7732939 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:47.535204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-30cead08-1dd5-46cb-b97a-16e5c7732939 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:47.537032 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-30cead08-1dd5-46cb-b97a-16e5c7732939 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:47.537572 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-30cead08-1dd5-46cb-b97a-16e5c7732939 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:47.590075 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-d7386af9-18b9-42d2-b236-e868f51740f1 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:47.590867 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-d7386af9-18b9-42d2-b236-e868f51740f1 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:47.606735 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d7386af9-18b9-42d2-b236-e868f51740f1 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:47.612070 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d7386af9-18b9-42d2-b236-e868f51740f1 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:47.613451 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d7386af9-18b9-42d2-b236-e868f51740f1 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:47.617943 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d7386af9-18b9-42d2-b236-e868f51740f1 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:47.618491 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d7386af9-18b9-42d2-b236-e868f51740f1 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:47.620149 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d7386af9-18b9-42d2-b236-e868f51740f1 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:47.898777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-d7386af9-18b9-42d2-b236-e868f51740f1 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:47.916279 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-d7386af9-18b9-42d2-b236-e868f51740f1 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1363 microversion: 2.1 time: 0.332765 Aug 31 09:48:47.920806 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-30cead08-1dd5-46cb-b97a-16e5c7732939 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:47.930053 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 56/124] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:47 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1363 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:47.936941 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-ed297c24-37d1-48fb-8420-36711de501a0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:47.937600 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-ed297c24-37d1-48fb-8420-36711de501a0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:47.946389 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ed297c24-37d1-48fb-8420-36711de501a0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:47.946941 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ed297c24-37d1-48fb-8420-36711de501a0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:47.947474 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ed297c24-37d1-48fb-8420-36711de501a0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:47.948147 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ed297c24-37d1-48fb-8420-36711de501a0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:47.948809 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ed297c24-37d1-48fb-8420-36711de501a0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:47.949639 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ed297c24-37d1-48fb-8420-36711de501a0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:47.962658 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-30cead08-1dd5-46cb-b97a-16e5c7732939 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1315 microversion: 2.1 time: 0.480256 Aug 31 09:48:47.978889 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 69/125] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:47 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:48.145401 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-ed297c24-37d1-48fb-8420-36711de501a0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:48.159459 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-ed297c24-37d1-48fb-8420-36711de501a0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1321 microversion: 2.1 time: 0.227767 Aug 31 09:48:48.162589 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 57/126] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:47 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:48.944932 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-188e2c03-9cb1-40c3-ace7-bc1e16a78c1c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:48.945590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-188e2c03-9cb1-40c3-ace7-bc1e16a78c1c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:48.966137 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-188e2c03-9cb1-40c3-ace7-bc1e16a78c1c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:48.968287 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-188e2c03-9cb1-40c3-ace7-bc1e16a78c1c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:48.969706 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-188e2c03-9cb1-40c3-ace7-bc1e16a78c1c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:48.970807 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-188e2c03-9cb1-40c3-ace7-bc1e16a78c1c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:48.971605 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-188e2c03-9cb1-40c3-ace7-bc1e16a78c1c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:48.972668 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-188e2c03-9cb1-40c3-ace7-bc1e16a78c1c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:48.980638 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=100 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:49.009687 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-55b744e6-d666-4502-b7f8-23fd78381674 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:49.010290 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-55b744e6-d666-4502-b7f8-23fd78381674 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:49.029892 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-55b744e6-d666-4502-b7f8-23fd78381674 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:49.029892 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-55b744e6-d666-4502-b7f8-23fd78381674 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:49.029892 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-55b744e6-d666-4502-b7f8-23fd78381674 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:49.029892 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-55b744e6-d666-4502-b7f8-23fd78381674 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:49.030156 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-55b744e6-d666-4502-b7f8-23fd78381674 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:49.030156 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-55b744e6-d666-4502-b7f8-23fd78381674 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:49.551725 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-188e2c03-9cb1-40c3-ace7-bc1e16a78c1c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:49.574334 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-188e2c03-9cb1-40c3-ace7-bc1e16a78c1c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1363 microversion: 2.1 time: 0.635346 Aug 31 09:48:49.578934 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 70/127] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:48 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1363 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:48:49.598587 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b1f45832-3227-4cce-b6d2-26392c304387 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:49.602515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b1f45832-3227-4cce-b6d2-26392c304387 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:49.628692 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b1f45832-3227-4cce-b6d2-26392c304387 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:49.629281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b1f45832-3227-4cce-b6d2-26392c304387 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:49.629770 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b1f45832-3227-4cce-b6d2-26392c304387 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:49.632205 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b1f45832-3227-4cce-b6d2-26392c304387 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:49.634191 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b1f45832-3227-4cce-b6d2-26392c304387 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:49.634834 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b1f45832-3227-4cce-b6d2-26392c304387 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:49.704359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-55b744e6-d666-4502-b7f8-23fd78381674 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:49.727710 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-55b744e6-d666-4502-b7f8-23fd78381674 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1502 microversion: 2.1 time: 0.724355 Aug 31 09:48:49.745439 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 58/128] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:49 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1502 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:49.745439 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-da493a34-f287-4049-9944-09ae91849d27 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1242010557", "imageRef": "8e078bb9-f274-4984-8128-d31407d49604", "flavorRef": "452", "networks": [{"uuid": "9aad165a-e9a5-4348-86e8-f13640f54588"}]}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:49.842423 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.network.neutron [None req-da493a34-f287-4049-9944-09ae91849d27 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] validate_networks() for [('9aad165a-e9a5-4348-86e8-f13640f54588', None, None, None, None, None)] {{(pid=127171) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:48:50.130823 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b1f45832-3227-4cce-b6d2-26392c304387 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:50.160368 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b1f45832-3227-4cce-b6d2-26392c304387 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1321 microversion: 2.1 time: 0.569710 Aug 31 09:48:50.162092 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 71/129] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:49 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1321 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:50.619219 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a264a1b5-0a1a-465e-b96d-13c1d23ee58e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:50.622987 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-a264a1b5-0a1a-465e-b96d-13c1d23ee58e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:50.647282 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a264a1b5-0a1a-465e-b96d-13c1d23ee58e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:50.648499 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a264a1b5-0a1a-465e-b96d-13c1d23ee58e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:50.649584 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a264a1b5-0a1a-465e-b96d-13c1d23ee58e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:50.658929 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a264a1b5-0a1a-465e-b96d-13c1d23ee58e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:50.660274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a264a1b5-0a1a-465e-b96d-13c1d23ee58e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:50.662263 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a264a1b5-0a1a-465e-b96d-13c1d23ee58e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:51.011731 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-da493a34-f287-4049-9944-09ae91849d27 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Flavor limits 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:48:51.014993 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-da493a34-f287-4049-9944-09ae91849d27 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Image limits 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:48:51.015886 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-da493a34-f287-4049-9944-09ae91849d27 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Flavor pref 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:48:51.016538 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-da493a34-f287-4049-9944-09ae91849d27 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Image pref 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:48:51.017217 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-da493a34-f287-4049-9944-09ae91849d27 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:48:51.037004 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-a264a1b5-0a1a-465e-b96d-13c1d23ee58e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:51.044015 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a264a1b5-0a1a-465e-b96d-13c1d23ee58e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1363 microversion: 2.1 time: 0.432961 Aug 31 09:48:51.047370 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-da493a34-f287-4049-9944-09ae91849d27 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:51.048124 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-da493a34-f287-4049-9944-09ae91849d27 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:51.048619 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 72/130] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:50 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1363 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:51.049288 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-da493a34-f287-4049-9944-09ae91849d27 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:51.050952 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-da493a34-f287-4049-9944-09ae91849d27 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:51.052056 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-da493a34-f287-4049-9944-09ae91849d27 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:51.052694 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-da493a34-f287-4049-9944-09ae91849d27 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:51.088070 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-da493a34-f287-4049-9944-09ae91849d27 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Getting quotas for project 0d7d52f95e5e452ca2ac11900fc0d931. Resources: {'ram', 'instances', 'cores'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:48:51.093281 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-da493a34-f287-4049-9944-09ae91849d27 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Getting quotas for user c475984de9e84ff18fb96c588a07c80b and project 0d7d52f95e5e452ca2ac11900fc0d931. Resources: {'ram', 'instances', 'cores'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:48:51.122004 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-da493a34-f287-4049-9944-09ae91849d27 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Going to run 1 instances... {{(pid=127171) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:48:51.124692 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-da493a34-f287-4049-9944-09ae91849d27 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8e078bb9-f274-4984-8128-d31407d49604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:48:51.193502 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-253db2a8-68bb-48b4-8326-6c979a2c1c58 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:51.194270 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-253db2a8-68bb-48b4-8326-6c979a2c1c58 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:51.214541 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-253db2a8-68bb-48b4-8326-6c979a2c1c58 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:51.216034 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-253db2a8-68bb-48b4-8326-6c979a2c1c58 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:51.216498 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-253db2a8-68bb-48b4-8326-6c979a2c1c58 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:51.216918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-da493a34-f287-4049-9944-09ae91849d27 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.482067 Aug 31 09:48:51.219004 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 59/131] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 31 09:48:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:48:51.219532 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-253db2a8-68bb-48b4-8326-6c979a2c1c58 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:51.220025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-253db2a8-68bb-48b4-8326-6c979a2c1c58 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:51.220570 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-253db2a8-68bb-48b4-8326-6c979a2c1c58 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:51.232776 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-599f515f-8c12-4352-b100-31888a19465f tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:51.234348 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-599f515f-8c12-4352-b100-31888a19465f tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:51.437229 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-599f515f-8c12-4352-b100-31888a19465f tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:51.465951 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-599f515f-8c12-4352-b100-31888a19465f tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91" status: 200 len: 1214 microversion: 2.1 time: 0.237553 Aug 31 09:48:51.470057 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 60/132] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:51 2022] GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91 => generated 1214 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:51.646560 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-253db2a8-68bb-48b4-8326-6c979a2c1c58 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:51.710506 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-253db2a8-68bb-48b4-8326-6c979a2c1c58 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1321 microversion: 2.1 time: 0.517155 Aug 31 09:48:51.717406 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 73/133] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:51 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1321 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:52.071979 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-56395f06-0681-4cc3-8eb1-0161b9862224 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5beb010b-8c7b-49b7-9303-6d3403ebb7c9"}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:52.079929 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-56395f06-0681-4cc3-8eb1-0161b9862224 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:52.082592 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-33270bc1-538d-444e-b1a1-586af45bcf56 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:52.083390 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-33270bc1-538d-444e-b1a1-586af45bcf56 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:52.094089 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-33270bc1-538d-444e-b1a1-586af45bcf56 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:52.094680 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-33270bc1-538d-444e-b1a1-586af45bcf56 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:52.098710 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-33270bc1-538d-444e-b1a1-586af45bcf56 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:52.100275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-56395f06-0681-4cc3-8eb1-0161b9862224 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:52.101642 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-33270bc1-538d-444e-b1a1-586af45bcf56 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:52.101999 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-56395f06-0681-4cc3-8eb1-0161b9862224 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:52.103682 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-56395f06-0681-4cc3-8eb1-0161b9862224 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:52.104070 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-33270bc1-538d-444e-b1a1-586af45bcf56 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:52.104641 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-33270bc1-538d-444e-b1a1-586af45bcf56 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:52.106201 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-56395f06-0681-4cc3-8eb1-0161b9862224 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:52.108065 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-56395f06-0681-4cc3-8eb1-0161b9862224 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:52.111503 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-56395f06-0681-4cc3-8eb1-0161b9862224 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:52.556858 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-33270bc1-538d-444e-b1a1-586af45bcf56 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:52.576657 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-33270bc1-538d-444e-b1a1-586af45bcf56 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1363 microversion: 2.1 time: 0.498872 Aug 31 09:48:52.577928 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 74/134] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:52 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1363 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:52.590292 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-80e78a1c-4430-4a7b-aa36-684cb045b5d6 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:52.591904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-80e78a1c-4430-4a7b-aa36-684cb045b5d6 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:52.611103 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-80e78a1c-4430-4a7b-aa36-684cb045b5d6 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:52.612743 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-80e78a1c-4430-4a7b-aa36-684cb045b5d6 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:52.616339 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-80e78a1c-4430-4a7b-aa36-684cb045b5d6 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:52.618471 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-80e78a1c-4430-4a7b-aa36-684cb045b5d6 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:52.619651 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-80e78a1c-4430-4a7b-aa36-684cb045b5d6 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:52.620711 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-80e78a1c-4430-4a7b-aa36-684cb045b5d6 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:52.838453 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-80e78a1c-4430-4a7b-aa36-684cb045b5d6 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:52.880773 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-80e78a1c-4430-4a7b-aa36-684cb045b5d6 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91" status: 200 len: 1218 microversion: 2.1 time: 0.277176 Aug 31 09:48:52.884007 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 75/135] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:52 2022] GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91 => generated 1218 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:52.912389 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-8cc0ed8a-d849-4520-90b5-0a5f517810a6 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:52.913591 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-8cc0ed8a-d849-4520-90b5-0a5f517810a6 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:52.955496 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8cc0ed8a-d849-4520-90b5-0a5f517810a6 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:52.958216 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8cc0ed8a-d849-4520-90b5-0a5f517810a6 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:52.959559 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8cc0ed8a-d849-4520-90b5-0a5f517810a6 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:52.966907 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8cc0ed8a-d849-4520-90b5-0a5f517810a6 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:52.969767 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8cc0ed8a-d849-4520-90b5-0a5f517810a6 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:52.970419 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8cc0ed8a-d849-4520-90b5-0a5f517810a6 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:53.632143 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-8cc0ed8a-d849-4520-90b5-0a5f517810a6 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:53.680777 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-8cc0ed8a-d849-4520-90b5-0a5f517810a6 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1515 microversion: 2.1 time: 0.793980 Aug 31 09:48:53.681853 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 76/136] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:52 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1515 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:53.708297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-aee8e774-10e3-4cb2-a7ad-414770588410 req-e6fd7349-7679-40e9-87da-2efacc7b7655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e598a8ab-5332-4c3c-8f72-098d0ac6a3c8", "name": "network-vif-plugged", "status": "completed", "tag": "cae2bef1-d3f5-4bd0-b345-99fbc7e354b9"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:53.709473 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-56395f06-0681-4cc3-8eb1-0161b9862224 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "POST /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.645881 Aug 31 09:48:53.711379 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 61/137] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 31 09:48:52 2022] POST /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d/os-volume_attachments => generated 194 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:53.724840 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-5f9e87bc-937b-4ce7-8a10-2283c6e57f46 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:53.726817 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-5f9e87bc-937b-4ce7-8a10-2283c6e57f46 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:53.736283 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5f9e87bc-937b-4ce7-8a10-2283c6e57f46 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:53.737351 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5f9e87bc-937b-4ce7-8a10-2283c6e57f46 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:53.738869 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5f9e87bc-937b-4ce7-8a10-2283c6e57f46 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:53.741673 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5f9e87bc-937b-4ce7-8a10-2283c6e57f46 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:53.742899 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5f9e87bc-937b-4ce7-8a10-2283c6e57f46 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:53.744189 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5f9e87bc-937b-4ce7-8a10-2283c6e57f46 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:53.757248 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-aee8e774-10e3-4cb2-a7ad-414770588410 req-e6fd7349-7679-40e9-87da-2efacc7b7655 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:53.757923 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-aee8e774-10e3-4cb2-a7ad-414770588410 req-e6fd7349-7679-40e9-87da-2efacc7b7655 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:53.759392 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-aee8e774-10e3-4cb2-a7ad-414770588410 req-e6fd7349-7679-40e9-87da-2efacc7b7655 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:53.802153 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-aee8e774-10e3-4cb2-a7ad-414770588410 req-e6fd7349-7679-40e9-87da-2efacc7b7655 service nova] Creating event network-vif-plugged:cae2bef1-d3f5-4bd0-b345-99fbc7e354b9 for instance e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 on hv-cinder-84496 Aug 31 09:48:53.818210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-aee8e774-10e3-4cb2-a7ad-414770588410 req-e6fd7349-7679-40e9-87da-2efacc7b7655 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131309 Aug 31 09:48:53.821081 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 77/138] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:53.836867 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a8ce7cbb-7be6-477f-ac0c-7e92b4ddf60f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:53.844655 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-a8ce7cbb-7be6-477f-ac0c-7e92b4ddf60f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:53.869919 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a8ce7cbb-7be6-477f-ac0c-7e92b4ddf60f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:53.871092 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a8ce7cbb-7be6-477f-ac0c-7e92b4ddf60f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:53.872845 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a8ce7cbb-7be6-477f-ac0c-7e92b4ddf60f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:53.875069 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a8ce7cbb-7be6-477f-ac0c-7e92b4ddf60f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:53.877233 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a8ce7cbb-7be6-477f-ac0c-7e92b4ddf60f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:53.878602 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a8ce7cbb-7be6-477f-ac0c-7e92b4ddf60f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:54.170397 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.objects.instance [None req-a8ce7cbb-7be6-477f-ac0c-7e92b4ddf60f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lazy-loading 'flavor' on Instance uuid 74c8f70a-11b4-47de-9677-637917aa5115 {{(pid=127170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:48:54.229223 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-5f9e87bc-937b-4ce7-8a10-2283c6e57f46 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:54.242331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-5f9e87bc-937b-4ce7-8a10-2283c6e57f46 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1363 microversion: 2.1 time: 0.528651 Aug 31 09:48:54.242929 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 62/139] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:53 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1363 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:54.250376 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-20501fa0-6e15-47d0-84bb-6ce125f90a60 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:54.251683 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-20501fa0-6e15-47d0-84bb-6ce125f90a60 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:54.281502 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-20501fa0-6e15-47d0-84bb-6ce125f90a60 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:54.290544 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-20501fa0-6e15-47d0-84bb-6ce125f90a60 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:54.291990 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-20501fa0-6e15-47d0-84bb-6ce125f90a60 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:54.293697 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-20501fa0-6e15-47d0-84bb-6ce125f90a60 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:54.296998 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-20501fa0-6e15-47d0-84bb-6ce125f90a60 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:54.306346 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-20501fa0-6e15-47d0-84bb-6ce125f90a60 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:54.595060 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a8ce7cbb-7be6-477f-ac0c-7e92b4ddf60f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "POST /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115/action" status: 200 len: 32 microversion: 2.1 time: 0.766152 Aug 31 09:48:54.597483 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 78/140] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 31 09:48:53 2022] POST /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115/action => generated 32 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 09:48:54.617117 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-c7eb5e49-5bce-456e-b0f9-f91e50f2788b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:54.618130 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-c7eb5e49-5bce-456e-b0f9-f91e50f2788b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:54.626776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c7eb5e49-5bce-456e-b0f9-f91e50f2788b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:54.628601 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c7eb5e49-5bce-456e-b0f9-f91e50f2788b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:54.629330 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c7eb5e49-5bce-456e-b0f9-f91e50f2788b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:54.630324 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c7eb5e49-5bce-456e-b0f9-f91e50f2788b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:54.630964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c7eb5e49-5bce-456e-b0f9-f91e50f2788b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:54.631545 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c7eb5e49-5bce-456e-b0f9-f91e50f2788b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:54.692211 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-20501fa0-6e15-47d0-84bb-6ce125f90a60 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:54.704310 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-20501fa0-6e15-47d0-84bb-6ce125f90a60 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91" status: 200 len: 1266 microversion: 2.1 time: 0.460088 Aug 31 09:48:54.710960 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 63/141] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:54 2022] GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91 => generated 1266 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:55.165926 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-c7eb5e49-5bce-456e-b0f9-f91e50f2788b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:55.179490 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-c7eb5e49-5bce-456e-b0f9-f91e50f2788b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.568669 Aug 31 09:48:55.194244 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 79/142] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:54 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:55.301958 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-1aea4b21-aaeb-480e-9b4e-dfe15ea9ddc7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:55.303122 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-1aea4b21-aaeb-480e-9b4e-dfe15ea9ddc7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:55.331564 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1aea4b21-aaeb-480e-9b4e-dfe15ea9ddc7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:55.332639 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1aea4b21-aaeb-480e-9b4e-dfe15ea9ddc7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:55.333645 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1aea4b21-aaeb-480e-9b4e-dfe15ea9ddc7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:55.335053 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1aea4b21-aaeb-480e-9b4e-dfe15ea9ddc7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:55.335891 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1aea4b21-aaeb-480e-9b4e-dfe15ea9ddc7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:55.336645 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1aea4b21-aaeb-480e-9b4e-dfe15ea9ddc7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:55.733784 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b0fa8ddf-3adc-49b4-a855-cddcd0b90b9c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:55.736312 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b0fa8ddf-3adc-49b4-a855-cddcd0b90b9c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:55.751195 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b0fa8ddf-3adc-49b4-a855-cddcd0b90b9c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:55.753874 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b0fa8ddf-3adc-49b4-a855-cddcd0b90b9c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:55.756541 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b0fa8ddf-3adc-49b4-a855-cddcd0b90b9c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:55.758200 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b0fa8ddf-3adc-49b4-a855-cddcd0b90b9c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:55.759759 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b0fa8ddf-3adc-49b4-a855-cddcd0b90b9c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:55.761126 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b0fa8ddf-3adc-49b4-a855-cddcd0b90b9c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:55.914773 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b0fa8ddf-3adc-49b4-a855-cddcd0b90b9c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:55.927539 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b0fa8ddf-3adc-49b4-a855-cddcd0b90b9c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91" status: 200 len: 1272 microversion: 2.1 time: 0.204324 Aug 31 09:48:55.928805 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 80/143] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:55 2022] GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91 => generated 1272 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:48:56.036776 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-1aea4b21-aaeb-480e-9b4e-dfe15ea9ddc7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:56.048857 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-1aea4b21-aaeb-480e-9b4e-dfe15ea9ddc7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1363 microversion: 2.1 time: 0.769332 Aug 31 09:48:56.061900 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 64/144] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:55 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1363 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:56.201207 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-d0342337-6f30-45a9-b53e-2cd17bf3ab63 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:56.202557 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-d0342337-6f30-45a9-b53e-2cd17bf3ab63 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:56.222957 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d0342337-6f30-45a9-b53e-2cd17bf3ab63 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:56.223969 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d0342337-6f30-45a9-b53e-2cd17bf3ab63 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:56.227030 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d0342337-6f30-45a9-b53e-2cd17bf3ab63 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:56.232474 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d0342337-6f30-45a9-b53e-2cd17bf3ab63 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:56.233331 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d0342337-6f30-45a9-b53e-2cd17bf3ab63 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:56.234185 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d0342337-6f30-45a9-b53e-2cd17bf3ab63 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:56.677449 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-d0342337-6f30-45a9-b53e-2cd17bf3ab63 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:56.694801 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-d0342337-6f30-45a9-b53e-2cd17bf3ab63 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.496920 Aug 31 09:48:56.699489 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 81/145] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:56 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:48:56.962523 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-0818266d-eb07-460d-9a05-d178235714c8 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:56.964375 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-0818266d-eb07-460d-9a05-d178235714c8 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:56.984707 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:56.998655 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0818266d-eb07-460d-9a05-d178235714c8 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:56.999432 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0818266d-eb07-460d-9a05-d178235714c8 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:57.000784 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0818266d-eb07-460d-9a05-d178235714c8 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:57.002677 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0818266d-eb07-460d-9a05-d178235714c8 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:57.003791 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0818266d-eb07-460d-9a05-d178235714c8 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:57.004808 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0818266d-eb07-460d-9a05-d178235714c8 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:57.079502 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-6de7a620-781b-471e-a823-fd68e2c91e7c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:57.081672 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-6de7a620-781b-471e-a823-fd68e2c91e7c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:57.097524 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6de7a620-781b-471e-a823-fd68e2c91e7c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:57.099956 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6de7a620-781b-471e-a823-fd68e2c91e7c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:57.102024 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6de7a620-781b-471e-a823-fd68e2c91e7c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:57.111093 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6de7a620-781b-471e-a823-fd68e2c91e7c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:57.114444 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6de7a620-781b-471e-a823-fd68e2c91e7c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:57.115971 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6de7a620-781b-471e-a823-fd68e2c91e7c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:57.863614 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-6de7a620-781b-471e-a823-fd68e2c91e7c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:57.899369 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-6de7a620-781b-471e-a823-fd68e2c91e7c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1363 microversion: 2.1 time: 0.816661 Aug 31 09:48:57.901793 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 82/146] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:57 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1363 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:48:57.917003 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-4763c7f0-d563-41bb-ba1a-9f70ce26484a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:57.928310 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-4763c7f0-d563-41bb-ba1a-9f70ce26484a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:57.932217 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=66 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:57.948641 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4763c7f0-d563-41bb-ba1a-9f70ce26484a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:57.949164 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4763c7f0-d563-41bb-ba1a-9f70ce26484a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:57.949669 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4763c7f0-d563-41bb-ba1a-9f70ce26484a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:57.950582 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4763c7f0-d563-41bb-ba1a-9f70ce26484a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:57.956732 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4763c7f0-d563-41bb-ba1a-9f70ce26484a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:57.959214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4763c7f0-d563-41bb-ba1a-9f70ce26484a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:58.078441 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-0818266d-eb07-460d-9a05-d178235714c8 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:58.109726 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-0818266d-eb07-460d-9a05-d178235714c8 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91" status: 200 len: 1314 microversion: 2.1 time: 1.159138 Aug 31 09:48:58.116954 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 65/147] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:56 2022] GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91 => generated 1314 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:58.473441 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-4763c7f0-d563-41bb-ba1a-9f70ce26484a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:58.499070 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-4763c7f0-d563-41bb-ba1a-9f70ce26484a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.595062 Aug 31 09:48:58.500066 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 83/148] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:57 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:58.925788 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-ad2832ba-74ba-4562-a9d3-f80b4a3cd4f7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:58.926147 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-ad2832ba-74ba-4562-a9d3-f80b4a3cd4f7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:58.943492 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ad2832ba-74ba-4562-a9d3-f80b4a3cd4f7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:58.943492 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ad2832ba-74ba-4562-a9d3-f80b4a3cd4f7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:58.943492 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ad2832ba-74ba-4562-a9d3-f80b4a3cd4f7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:58.943492 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ad2832ba-74ba-4562-a9d3-f80b4a3cd4f7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:58.944057 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ad2832ba-74ba-4562-a9d3-f80b4a3cd4f7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:58.944057 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ad2832ba-74ba-4562-a9d3-f80b4a3cd4f7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:59.136298 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-315fd721-2a2b-4301-b2fe-ce43b398194e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:59.137185 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-315fd721-2a2b-4301-b2fe-ce43b398194e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:59.144385 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-315fd721-2a2b-4301-b2fe-ce43b398194e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:59.145208 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-315fd721-2a2b-4301-b2fe-ce43b398194e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:59.146588 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-315fd721-2a2b-4301-b2fe-ce43b398194e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:59.147798 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-315fd721-2a2b-4301-b2fe-ce43b398194e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:59.148452 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-315fd721-2a2b-4301-b2fe-ce43b398194e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:59.150103 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-315fd721-2a2b-4301-b2fe-ce43b398194e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:59.237737 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-ad2832ba-74ba-4562-a9d3-f80b4a3cd4f7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:59.248312 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-ad2832ba-74ba-4562-a9d3-f80b4a3cd4f7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1549 microversion: 2.1 time: 0.328334 Aug 31 09:48:59.252661 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 66/149] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:58 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1549 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:48:59.265692 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-57a61af1-0662-4689-a1b1-a42726a747c3 req-6b26a996-bc2a-471b-a3bd-c967bbc5cc26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9c8d616-8c5b-4060-ac1f-1386107a7f91", "tag": "b2ed2dcc-e09a-4bc1-a617-4e0573eb3d3d"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:59.294835 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-57a61af1-0662-4689-a1b1-a42726a747c3 req-6b26a996-bc2a-471b-a3bd-c967bbc5cc26 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:59.294835 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-57a61af1-0662-4689-a1b1-a42726a747c3 req-6b26a996-bc2a-471b-a3bd-c967bbc5cc26 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:59.296053 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-57a61af1-0662-4689-a1b1-a42726a747c3 req-6b26a996-bc2a-471b-a3bd-c967bbc5cc26 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:59.336158 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-57a61af1-0662-4689-a1b1-a42726a747c3 req-6b26a996-bc2a-471b-a3bd-c967bbc5cc26 service nova] Creating event network-changed:b2ed2dcc-e09a-4bc1-a617-4e0573eb3d3d for instance b9c8d616-8c5b-4060-ac1f-1386107a7f91 on hv-cinder-84496 Aug 31 09:48:59.345952 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-57a61af1-0662-4689-a1b1-a42726a747c3 req-6b26a996-bc2a-471b-a3bd-c967bbc5cc26 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091566 Aug 31 09:48:59.351014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 67/150] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:59.367046 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c83e6ec9-a125-486b-b67e-f60d975ef2ec tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:59.368761 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c83e6ec9-a125-486b-b67e-f60d975ef2ec tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:59.386195 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c83e6ec9-a125-486b-b67e-f60d975ef2ec tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:59.386957 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c83e6ec9-a125-486b-b67e-f60d975ef2ec tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:59.387466 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c83e6ec9-a125-486b-b67e-f60d975ef2ec tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:59.390549 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c83e6ec9-a125-486b-b67e-f60d975ef2ec tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:59.391240 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c83e6ec9-a125-486b-b67e-f60d975ef2ec tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:59.393130 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c83e6ec9-a125-486b-b67e-f60d975ef2ec tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:59.399764 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:59.709797 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c83e6ec9-a125-486b-b67e-f60d975ef2ec tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.356206 Aug 31 09:48:59.718398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 68/151] 10.222.0.13 () {58 vars in 1275 bytes} [Wed Aug 31 09:48:59 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8/os-interface => generated 284 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:59.725268 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c4384172-ee72-47d7-a9df-4b24253af6f7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:59.727107 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c4384172-ee72-47d7-a9df-4b24253af6f7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:59.742240 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4384172-ee72-47d7-a9df-4b24253af6f7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:59.743867 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4384172-ee72-47d7-a9df-4b24253af6f7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:59.747956 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4384172-ee72-47d7-a9df-4b24253af6f7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:59.748958 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4384172-ee72-47d7-a9df-4b24253af6f7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:59.749690 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4384172-ee72-47d7-a9df-4b24253af6f7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:59.751849 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4384172-ee72-47d7-a9df-4b24253af6f7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:59.756174 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-315fd721-2a2b-4301-b2fe-ce43b398194e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:59.782118 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-315fd721-2a2b-4301-b2fe-ce43b398194e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91" status: 200 len: 1314 microversion: 2.1 time: 0.648925 Aug 31 09:48:59.788681 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 84/152] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:59 2022] GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91 => generated 1314 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:00.287656 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c4384172-ee72-47d7-a9df-4b24253af6f7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:00.332460 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c4384172-ee72-47d7-a9df-4b24253af6f7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.609055 Aug 31 09:49:00.337253 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 69/153] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:59 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:00.814104 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-7caa9777-e01b-48f3-ae38-0bcf408a3f51 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:00.814725 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-7caa9777-e01b-48f3-ae38-0bcf408a3f51 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:00.825968 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7caa9777-e01b-48f3-ae38-0bcf408a3f51 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:00.826657 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7caa9777-e01b-48f3-ae38-0bcf408a3f51 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:00.828707 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7caa9777-e01b-48f3-ae38-0bcf408a3f51 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:00.829850 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7caa9777-e01b-48f3-ae38-0bcf408a3f51 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:00.831750 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7caa9777-e01b-48f3-ae38-0bcf408a3f51 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:00.832954 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7caa9777-e01b-48f3-ae38-0bcf408a3f51 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:00.851961 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:01.359286 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-487b6ebf-aa60-406b-80e3-4dce85c8e1ae tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:01.360132 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-487b6ebf-aa60-406b-80e3-4dce85c8e1ae tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:01.363933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=2 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:01.371462 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-487b6ebf-aa60-406b-80e3-4dce85c8e1ae tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:01.372150 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-487b6ebf-aa60-406b-80e3-4dce85c8e1ae tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:01.372468 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-487b6ebf-aa60-406b-80e3-4dce85c8e1ae tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:01.373419 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-487b6ebf-aa60-406b-80e3-4dce85c8e1ae tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:01.373896 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-487b6ebf-aa60-406b-80e3-4dce85c8e1ae tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:01.374370 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-487b6ebf-aa60-406b-80e3-4dce85c8e1ae tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:01.423690 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-7caa9777-e01b-48f3-ae38-0bcf408a3f51 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:01.435334 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-7caa9777-e01b-48f3-ae38-0bcf408a3f51 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91" status: 200 len: 1314 microversion: 2.1 time: 0.624889 Aug 31 09:49:01.436893 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 85/154] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:00 2022] GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91 => generated 1314 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:01.450688 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=8 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:01.690124 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-487b6ebf-aa60-406b-80e3-4dce85c8e1ae tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:01.703711 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-487b6ebf-aa60-406b-80e3-4dce85c8e1ae tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.348790 Aug 31 09:49:01.707681 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 70/155] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:01 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:01.775689 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-33888f82-c8fb-4032-ad37-e8d7e3ccf395 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:01.776285 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-33888f82-c8fb-4032-ad37-e8d7e3ccf395 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:01.787355 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-33888f82-c8fb-4032-ad37-e8d7e3ccf395 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:01.792678 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-33888f82-c8fb-4032-ad37-e8d7e3ccf395 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:01.793418 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-33888f82-c8fb-4032-ad37-e8d7e3ccf395 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:01.795855 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-33888f82-c8fb-4032-ad37-e8d7e3ccf395 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:01.798306 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-33888f82-c8fb-4032-ad37-e8d7e3ccf395 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:01.798877 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-33888f82-c8fb-4032-ad37-e8d7e3ccf395 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:01.848404 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-33888f82-c8fb-4032-ad37-e8d7e3ccf395 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Going to try to terminate instance {{(pid=127170) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:49:01.971943 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-33888f82-c8fb-4032-ad37-e8d7e3ccf395 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 204 len: 0 microversion: 2.1 time: 0.200506 Aug 31 09:49:01.973280 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 86/156] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 09:49:01 2022] DELETE /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:49:01.984214 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9ee7352b-949c-40c7-ba95-946e6f4c4612 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:01.984916 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-9ee7352b-949c-40c7-ba95-946e6f4c4612 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:01.993086 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9ee7352b-949c-40c7-ba95-946e6f4c4612 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:01.993636 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9ee7352b-949c-40c7-ba95-946e6f4c4612 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:01.997029 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9ee7352b-949c-40c7-ba95-946e6f4c4612 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:02.002148 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9ee7352b-949c-40c7-ba95-946e6f4c4612 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:02.005432 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9ee7352b-949c-40c7-ba95-946e6f4c4612 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:02.006076 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9ee7352b-949c-40c7-ba95-946e6f4c4612 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:02.195210 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-9ee7352b-949c-40c7-ba95-946e6f4c4612 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:02.204411 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-9ee7352b-949c-40c7-ba95-946e6f4c4612 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1554 microversion: 2.1 time: 0.226275 Aug 31 09:49:02.205009 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 71/157] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:01 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1554 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:02.304251 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-3ebb2af3-5eef-471d-8a01-1fadd5d932e9 req-87d02dca-9ab6-4e6b-b420-dbe1a19e9571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e598a8ab-5332-4c3c-8f72-098d0ac6a3c8", "tag": "cae2bef1-d3f5-4bd0-b345-99fbc7e354b9"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:02.316656 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-3ebb2af3-5eef-471d-8a01-1fadd5d932e9 req-87d02dca-9ab6-4e6b-b420-dbe1a19e9571 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:02.317451 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-3ebb2af3-5eef-471d-8a01-1fadd5d932e9 req-87d02dca-9ab6-4e6b-b420-dbe1a19e9571 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:02.318049 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-3ebb2af3-5eef-471d-8a01-1fadd5d932e9 req-87d02dca-9ab6-4e6b-b420-dbe1a19e9571 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:02.336320 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-3ebb2af3-5eef-471d-8a01-1fadd5d932e9 req-87d02dca-9ab6-4e6b-b420-dbe1a19e9571 service nova] Creating event network-changed:cae2bef1-d3f5-4bd0-b345-99fbc7e354b9 for instance e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 on hv-cinder-84496 Aug 31 09:49:02.360232 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-3ebb2af3-5eef-471d-8a01-1fadd5d932e9 req-87d02dca-9ab6-4e6b-b420-dbe1a19e9571 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060296 Aug 31 09:49:02.364199 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 87/158] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:02.464258 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9c797a69-7e51-4586-8299-fc2c8bbe0a0b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:02.465747 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-9c797a69-7e51-4586-8299-fc2c8bbe0a0b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:02.486297 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9c797a69-7e51-4586-8299-fc2c8bbe0a0b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:02.486793 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9c797a69-7e51-4586-8299-fc2c8bbe0a0b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:02.487263 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9c797a69-7e51-4586-8299-fc2c8bbe0a0b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:02.488433 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9c797a69-7e51-4586-8299-fc2c8bbe0a0b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:02.489066 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9c797a69-7e51-4586-8299-fc2c8bbe0a0b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:02.489421 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9c797a69-7e51-4586-8299-fc2c8bbe0a0b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:02.731567 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-fc8d8388-03fb-4060-9176-132c6a7bee85 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:02.732463 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-fc8d8388-03fb-4060-9176-132c6a7bee85 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:02.746178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fc8d8388-03fb-4060-9176-132c6a7bee85 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:02.748598 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fc8d8388-03fb-4060-9176-132c6a7bee85 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:02.751942 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fc8d8388-03fb-4060-9176-132c6a7bee85 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:02.755888 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fc8d8388-03fb-4060-9176-132c6a7bee85 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:02.757307 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fc8d8388-03fb-4060-9176-132c6a7bee85 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:02.758317 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fc8d8388-03fb-4060-9176-132c6a7bee85 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:02.799532 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-9c797a69-7e51-4586-8299-fc2c8bbe0a0b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:02.843734 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-9c797a69-7e51-4586-8299-fc2c8bbe0a0b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91" status: 200 len: 1314 microversion: 2.1 time: 0.382472 Aug 31 09:49:02.863250 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 72/159] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:02 2022] GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91 => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:03.008317 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-fc8d8388-03fb-4060-9176-132c6a7bee85 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:03.020028 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-fc8d8388-03fb-4060-9176-132c6a7bee85 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.293658 Aug 31 09:49:03.023094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 88/160] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:02 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:03.234786 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-19e40637-7227-46c3-9767-25992946c406 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:03.236160 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-19e40637-7227-46c3-9767-25992946c406 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:03.252286 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-19e40637-7227-46c3-9767-25992946c406 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:03.254268 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-19e40637-7227-46c3-9767-25992946c406 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:03.255269 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-19e40637-7227-46c3-9767-25992946c406 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:03.257594 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-19e40637-7227-46c3-9767-25992946c406 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:03.259489 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-19e40637-7227-46c3-9767-25992946c406 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:03.261723 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-19e40637-7227-46c3-9767-25992946c406 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:03.563837 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-19e40637-7227-46c3-9767-25992946c406 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:03.584621 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-19e40637-7227-46c3-9767-25992946c406 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1554 microversion: 2.1 time: 0.356951 Aug 31 09:49:03.585668 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 73/161] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:03 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1554 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:03.878965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-8574cac7-7530-47ba-bc11-478e3d010163 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:03.879974 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-8574cac7-7530-47ba-bc11-478e3d010163 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:03.896009 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8574cac7-7530-47ba-bc11-478e3d010163 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:03.898939 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8574cac7-7530-47ba-bc11-478e3d010163 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:03.900296 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8574cac7-7530-47ba-bc11-478e3d010163 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:03.902113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8574cac7-7530-47ba-bc11-478e3d010163 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:03.902902 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8574cac7-7530-47ba-bc11-478e3d010163 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:03.904568 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8574cac7-7530-47ba-bc11-478e3d010163 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:04.050329 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-a69d3026-116d-42fe-9908-4db3e147de93 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:04.070601 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-a69d3026-116d-42fe-9908-4db3e147de93 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:04.098031 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a69d3026-116d-42fe-9908-4db3e147de93 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:04.099279 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a69d3026-116d-42fe-9908-4db3e147de93 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:04.100536 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a69d3026-116d-42fe-9908-4db3e147de93 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:04.102373 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a69d3026-116d-42fe-9908-4db3e147de93 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:04.103469 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a69d3026-116d-42fe-9908-4db3e147de93 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:04.104475 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a69d3026-116d-42fe-9908-4db3e147de93 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:04.433998 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-8574cac7-7530-47ba-bc11-478e3d010163 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:04.447677 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-8574cac7-7530-47ba-bc11-478e3d010163 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91" status: 200 len: 1314 microversion: 2.1 time: 0.583390 Aug 31 09:49:04.464043 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 89/162] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:03 2022] GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91 => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:04.609812 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f9d63ae7-4a85-4545-8ebe-a177fbaed5dd tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:04.610824 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-f9d63ae7-4a85-4545-8ebe-a177fbaed5dd tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:04.632062 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f9d63ae7-4a85-4545-8ebe-a177fbaed5dd tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:04.632989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f9d63ae7-4a85-4545-8ebe-a177fbaed5dd tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:04.634584 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f9d63ae7-4a85-4545-8ebe-a177fbaed5dd tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:04.635778 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f9d63ae7-4a85-4545-8ebe-a177fbaed5dd tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:04.640034 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f9d63ae7-4a85-4545-8ebe-a177fbaed5dd tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:04.640996 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f9d63ae7-4a85-4545-8ebe-a177fbaed5dd tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:04.671459 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-a69d3026-116d-42fe-9908-4db3e147de93 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:04.702200 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-a69d3026-116d-42fe-9908-4db3e147de93 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.660135 Aug 31 09:49:04.703197 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 74/163] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:04 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:04.997838 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-f9d63ae7-4a85-4545-8ebe-a177fbaed5dd tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:05.011776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-f9d63ae7-4a85-4545-8ebe-a177fbaed5dd tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1554 microversion: 2.1 time: 0.407297 Aug 31 09:49:05.016840 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 90/164] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:04 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1554 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:05.479374 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-f8a8087e-c752-435c-874e-0fd692c64717 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:05.480780 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-f8a8087e-c752-435c-874e-0fd692c64717 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:05.490152 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f8a8087e-c752-435c-874e-0fd692c64717 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:05.490853 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f8a8087e-c752-435c-874e-0fd692c64717 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:05.491869 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f8a8087e-c752-435c-874e-0fd692c64717 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:05.492932 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f8a8087e-c752-435c-874e-0fd692c64717 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:05.493758 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f8a8087e-c752-435c-874e-0fd692c64717 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:05.494681 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f8a8087e-c752-435c-874e-0fd692c64717 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:05.703381 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-f8a8087e-c752-435c-874e-0fd692c64717 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:05.721727 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-f8a8087e-c752-435c-874e-0fd692c64717 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91" status: 200 len: 1314 microversion: 2.1 time: 0.247321 Aug 31 09:49:05.723479 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 75/165] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:05 2022] GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:05.754652 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-6f34de5a-aca7-49f4-a15e-ab1a80b791e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:05.758908 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-6f34de5a-aca7-49f4-a15e-ab1a80b791e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:05.773037 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6f34de5a-aca7-49f4-a15e-ab1a80b791e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:05.773994 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6f34de5a-aca7-49f4-a15e-ab1a80b791e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:05.774765 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6f34de5a-aca7-49f4-a15e-ab1a80b791e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:05.775969 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6f34de5a-aca7-49f4-a15e-ab1a80b791e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:05.776826 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6f34de5a-aca7-49f4-a15e-ab1a80b791e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:05.777565 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6f34de5a-aca7-49f4-a15e-ab1a80b791e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:06.021203 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-6f34de5a-aca7-49f4-a15e-ab1a80b791e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:06.036372 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-6f34de5a-aca7-49f4-a15e-ab1a80b791e0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.292898 Aug 31 09:49:06.042466 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 91/166] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:05 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:06.056798 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-056c5b67-7761-4b74-a3da-2d283abb704d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:06.057615 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-056c5b67-7761-4b74-a3da-2d283abb704d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:06.065893 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-056c5b67-7761-4b74-a3da-2d283abb704d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:06.066588 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-056c5b67-7761-4b74-a3da-2d283abb704d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:06.068010 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-056c5b67-7761-4b74-a3da-2d283abb704d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:06.068818 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-056c5b67-7761-4b74-a3da-2d283abb704d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:06.069573 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-056c5b67-7761-4b74-a3da-2d283abb704d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:06.070042 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-056c5b67-7761-4b74-a3da-2d283abb704d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:06.388547 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-056c5b67-7761-4b74-a3da-2d283abb704d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:06.437818 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-056c5b67-7761-4b74-a3da-2d283abb704d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1554 microversion: 2.1 time: 0.402295 Aug 31 09:49:06.438992 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 76/167] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:06 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1554 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:06.748516 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-6ff91c9e-b0e1-4a8a-9189-56d7f44b03b0 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:06.749635 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-6ff91c9e-b0e1-4a8a-9189-56d7f44b03b0 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:06.768580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ff91c9e-b0e1-4a8a-9189-56d7f44b03b0 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:06.774902 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ff91c9e-b0e1-4a8a-9189-56d7f44b03b0 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:06.778072 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ff91c9e-b0e1-4a8a-9189-56d7f44b03b0 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:06.784297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ff91c9e-b0e1-4a8a-9189-56d7f44b03b0 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:06.785273 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ff91c9e-b0e1-4a8a-9189-56d7f44b03b0 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:06.786967 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ff91c9e-b0e1-4a8a-9189-56d7f44b03b0 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:07.060773 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-0a4f5dc3-cf88-4cc2-b8a3-59c768cecc13 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:07.061590 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-0a4f5dc3-cf88-4cc2-b8a3-59c768cecc13 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:07.074358 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0a4f5dc3-cf88-4cc2-b8a3-59c768cecc13 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:07.074926 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0a4f5dc3-cf88-4cc2-b8a3-59c768cecc13 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:07.075370 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0a4f5dc3-cf88-4cc2-b8a3-59c768cecc13 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:07.076095 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0a4f5dc3-cf88-4cc2-b8a3-59c768cecc13 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:07.085294 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0a4f5dc3-cf88-4cc2-b8a3-59c768cecc13 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:07.086207 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0a4f5dc3-cf88-4cc2-b8a3-59c768cecc13 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:07.222695 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-6ff91c9e-b0e1-4a8a-9189-56d7f44b03b0 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:07.236630 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-6ff91c9e-b0e1-4a8a-9189-56d7f44b03b0 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91" status: 200 len: 1314 microversion: 2.1 time: 0.493323 Aug 31 09:49:07.238155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 92/168] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:06 2022] GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91 => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:07.461506 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a13f03f6-0336-4609-81e8-1121e788fed6 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:07.462425 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-a13f03f6-0336-4609-81e8-1121e788fed6 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:07.469149 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a13f03f6-0336-4609-81e8-1121e788fed6 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:07.491334 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a13f03f6-0336-4609-81e8-1121e788fed6 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:07.492269 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a13f03f6-0336-4609-81e8-1121e788fed6 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:07.493992 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a13f03f6-0336-4609-81e8-1121e788fed6 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:07.494670 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a13f03f6-0336-4609-81e8-1121e788fed6 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:07.495308 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a13f03f6-0336-4609-81e8-1121e788fed6 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:07.705304 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-0a4f5dc3-cf88-4cc2-b8a3-59c768cecc13 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:07.730692 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-0a4f5dc3-cf88-4cc2-b8a3-59c768cecc13 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.673800 Aug 31 09:49:07.741839 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 77/169] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:07 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:08.253862 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-a13f03f6-0336-4609-81e8-1121e788fed6 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:08.264801 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a13f03f6-0336-4609-81e8-1121e788fed6 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1554 microversion: 2.1 time: 0.807510 Aug 31 09:49:08.265851 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 93/170] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:07 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1554 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:08.276851 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-d78d3705-4ca6-4262-aeac-61f504c789de tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:08.277557 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-d78d3705-4ca6-4262-aeac-61f504c789de tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:08.286224 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d78d3705-4ca6-4262-aeac-61f504c789de tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:08.287360 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d78d3705-4ca6-4262-aeac-61f504c789de tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:08.288526 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d78d3705-4ca6-4262-aeac-61f504c789de tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:08.291335 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d78d3705-4ca6-4262-aeac-61f504c789de tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:08.292734 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d78d3705-4ca6-4262-aeac-61f504c789de tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:08.294861 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d78d3705-4ca6-4262-aeac-61f504c789de tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:08.762243 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a5fab5fa-aba0-4558-b75f-4a18d473ef78 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:08.765145 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-a5fab5fa-aba0-4558-b75f-4a18d473ef78 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:08.786709 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a5fab5fa-aba0-4558-b75f-4a18d473ef78 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:08.788316 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a5fab5fa-aba0-4558-b75f-4a18d473ef78 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:08.791953 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a5fab5fa-aba0-4558-b75f-4a18d473ef78 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:08.793597 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a5fab5fa-aba0-4558-b75f-4a18d473ef78 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:08.795883 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a5fab5fa-aba0-4558-b75f-4a18d473ef78 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:08.801266 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a5fab5fa-aba0-4558-b75f-4a18d473ef78 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:09.033048 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-d78d3705-4ca6-4262-aeac-61f504c789de tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:09.050931 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-d78d3705-4ca6-4262-aeac-61f504c789de tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91" status: 200 len: 1314 microversion: 2.1 time: 0.782374 Aug 31 09:49:09.051894 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 78/171] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:08 2022] GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91 => generated 1314 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:09.071471 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-05281299-629c-44a7-8dcf-ed3b6d0fe22a req-05cb94d3-85f4-4b40-bf46-beabc6e701ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2dd468e-d0ef-4e78-be7f-9756e469206d", "name": "network-vif-deleted", "tag": "b3ab5cef-31da-4563-8e4d-463a5b47cb88"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:09.111556 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-05281299-629c-44a7-8dcf-ed3b6d0fe22a req-05cb94d3-85f4-4b40-bf46-beabc6e701ef service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:09.113730 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-05281299-629c-44a7-8dcf-ed3b6d0fe22a req-05cb94d3-85f4-4b40-bf46-beabc6e701ef service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:09.114686 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-05281299-629c-44a7-8dcf-ed3b6d0fe22a req-05cb94d3-85f4-4b40-bf46-beabc6e701ef service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:09.143591 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-05281299-629c-44a7-8dcf-ed3b6d0fe22a req-05cb94d3-85f4-4b40-bf46-beabc6e701ef service nova] Creating event network-vif-deleted:b3ab5cef-31da-4563-8e4d-463a5b47cb88 for instance d2dd468e-d0ef-4e78-be7f-9756e469206d on hv-cinder-84496 Aug 31 09:49:09.161124 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-05281299-629c-44a7-8dcf-ed3b6d0fe22a req-05cb94d3-85f4-4b40-bf46-beabc6e701ef service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106966 Aug 31 09:49:09.162382 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 79/172] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:09.275317 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-a5fab5fa-aba0-4558-b75f-4a18d473ef78 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:09.291961 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a5fab5fa-aba0-4558-b75f-4a18d473ef78 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.538379 Aug 31 09:49:09.293190 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 94/173] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:08 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:09.311711 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-7f256f52-9a6e-4689-8830-2575f919e79d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:09.316528 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-7f256f52-9a6e-4689-8830-2575f919e79d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:09.321660 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-3d5688be-bdb3-4ca5-8844-2927ad467d0f req-3d3ec4ee-790e-42ad-9536-6834f24d23d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c8d616-8c5b-4060-ac1f-1386107a7f91", "name": "network-vif-plugged", "status": "completed", "tag": "b2ed2dcc-e09a-4bc1-a617-4e0573eb3d3d"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:09.331463 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7f256f52-9a6e-4689-8830-2575f919e79d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:09.331875 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7f256f52-9a6e-4689-8830-2575f919e79d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:09.332331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7f256f52-9a6e-4689-8830-2575f919e79d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:09.333061 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7f256f52-9a6e-4689-8830-2575f919e79d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:09.333573 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7f256f52-9a6e-4689-8830-2575f919e79d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:09.333995 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7f256f52-9a6e-4689-8830-2575f919e79d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:09.338440 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-3d5688be-bdb3-4ca5-8844-2927ad467d0f req-3d3ec4ee-790e-42ad-9536-6834f24d23d3 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:09.339626 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-3d5688be-bdb3-4ca5-8844-2927ad467d0f req-3d3ec4ee-790e-42ad-9536-6834f24d23d3 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:09.340462 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-3d5688be-bdb3-4ca5-8844-2927ad467d0f req-3d3ec4ee-790e-42ad-9536-6834f24d23d3 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:09.358394 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-3d5688be-bdb3-4ca5-8844-2927ad467d0f req-3d3ec4ee-790e-42ad-9536-6834f24d23d3 service nova] Creating event network-vif-plugged:b2ed2dcc-e09a-4bc1-a617-4e0573eb3d3d for instance b9c8d616-8c5b-4060-ac1f-1386107a7f91 on hv-cinder-84496 Aug 31 09:49:09.368548 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-3d5688be-bdb3-4ca5-8844-2927ad467d0f req-3d3ec4ee-790e-42ad-9536-6834f24d23d3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051820 Aug 31 09:49:09.370024 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 95/174] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:09.506405 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7f256f52-9a6e-4689-8830-2575f919e79d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:09.525364 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-7f256f52-9a6e-4689-8830-2575f919e79d tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1346 microversion: 2.1 time: 0.236328 Aug 31 09:49:09.528609 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 80/175] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:09 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1346 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:10.075398 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-34029a2a-e665-48e4-b896-fd4cad28043d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:10.076301 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-34029a2a-e665-48e4-b896-fd4cad28043d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:10.084580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-34029a2a-e665-48e4-b896-fd4cad28043d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:10.085212 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-34029a2a-e665-48e4-b896-fd4cad28043d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:10.086108 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-34029a2a-e665-48e4-b896-fd4cad28043d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:10.087229 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-34029a2a-e665-48e4-b896-fd4cad28043d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:10.087708 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-34029a2a-e665-48e4-b896-fd4cad28043d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:10.088159 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-34029a2a-e665-48e4-b896-fd4cad28043d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:10.290313 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-34029a2a-e665-48e4-b896-fd4cad28043d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:10.300946 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-34029a2a-e665-48e4-b896-fd4cad28043d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91" status: 200 len: 1314 microversion: 2.1 time: 0.230817 Aug 31 09:49:10.301595 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 96/176] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:10 2022] GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:10.321810 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-d253315e-244d-4d0b-ae65-3a5b59c62493 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:10.323029 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-d253315e-244d-4d0b-ae65-3a5b59c62493 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:10.331401 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d253315e-244d-4d0b-ae65-3a5b59c62493 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:10.332157 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d253315e-244d-4d0b-ae65-3a5b59c62493 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:10.332766 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d253315e-244d-4d0b-ae65-3a5b59c62493 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:10.333619 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d253315e-244d-4d0b-ae65-3a5b59c62493 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:10.334150 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d253315e-244d-4d0b-ae65-3a5b59c62493 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:10.334670 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d253315e-244d-4d0b-ae65-3a5b59c62493 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:10.513875 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-d253315e-244d-4d0b-ae65-3a5b59c62493 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:10.525873 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-d253315e-244d-4d0b-ae65-3a5b59c62493 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.210380 Aug 31 09:49:10.526653 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 81/177] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:10 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:10.566856 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-150fa5fa-1ba7-455b-82a1-c487ca1b9ad2 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:10.567562 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-150fa5fa-1ba7-455b-82a1-c487ca1b9ad2 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:10.575290 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-150fa5fa-1ba7-455b-82a1-c487ca1b9ad2 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:10.575951 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-150fa5fa-1ba7-455b-82a1-c487ca1b9ad2 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:10.576444 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-150fa5fa-1ba7-455b-82a1-c487ca1b9ad2 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:10.577157 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-150fa5fa-1ba7-455b-82a1-c487ca1b9ad2 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:10.577843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-150fa5fa-1ba7-455b-82a1-c487ca1b9ad2 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:10.578267 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-150fa5fa-1ba7-455b-82a1-c487ca1b9ad2 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:10.625305 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-150fa5fa-1ba7-455b-82a1-c487ca1b9ad2 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:10.626469 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-150fa5fa-1ba7-455b-82a1-c487ca1b9ad2 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:10.627148 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-150fa5fa-1ba7-455b-82a1-c487ca1b9ad2 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:10.627961 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.objects.instance [None req-150fa5fa-1ba7-455b-82a1-c487ca1b9ad2 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lazy-loading 'fault' on Instance uuid d2dd468e-d0ef-4e78-be7f-9756e469206d {{(pid=127170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:49:10.696523 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-150fa5fa-1ba7-455b-82a1-c487ca1b9ad2 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:10.711162 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-150fa5fa-1ba7-455b-82a1-c487ca1b9ad2 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1351 microversion: 2.1 time: 0.149062 Aug 31 09:49:10.712130 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 97/178] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:10 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1351 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:11.339589 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-b79089ce-e881-4022-94b3-005997518434 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:11.340236 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-b79089ce-e881-4022-94b3-005997518434 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:11.365614 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b79089ce-e881-4022-94b3-005997518434 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:11.366118 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b79089ce-e881-4022-94b3-005997518434 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:11.366552 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b79089ce-e881-4022-94b3-005997518434 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:11.367270 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b79089ce-e881-4022-94b3-005997518434 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:11.367725 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b79089ce-e881-4022-94b3-005997518434 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:11.368153 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b79089ce-e881-4022-94b3-005997518434 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:11.551889 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-148e3d12-4f74-4bf6-98bf-6e9cd9b7feaf tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:11.553442 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-148e3d12-4f74-4bf6-98bf-6e9cd9b7feaf tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:11.568870 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-148e3d12-4f74-4bf6-98bf-6e9cd9b7feaf tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:11.569641 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-148e3d12-4f74-4bf6-98bf-6e9cd9b7feaf tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:11.570124 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-148e3d12-4f74-4bf6-98bf-6e9cd9b7feaf tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:11.574298 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-148e3d12-4f74-4bf6-98bf-6e9cd9b7feaf tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:11.576611 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-148e3d12-4f74-4bf6-98bf-6e9cd9b7feaf tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:11.582433 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-148e3d12-4f74-4bf6-98bf-6e9cd9b7feaf tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:11.617226 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b79089ce-e881-4022-94b3-005997518434 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:11.633621 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-b79089ce-e881-4022-94b3-005997518434 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91" status: 200 len: 1314 microversion: 2.1 time: 0.311139 Aug 31 09:49:11.634638 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 82/179] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:11 2022] GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:11.753887 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-f7aeb8f7-c218-4b82-942c-41e5a2cbd441 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:11.763519 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-f7aeb8f7-c218-4b82-942c-41e5a2cbd441 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:11.806938 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f7aeb8f7-c218-4b82-942c-41e5a2cbd441 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:11.809163 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f7aeb8f7-c218-4b82-942c-41e5a2cbd441 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:11.811034 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f7aeb8f7-c218-4b82-942c-41e5a2cbd441 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:11.816090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f7aeb8f7-c218-4b82-942c-41e5a2cbd441 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:11.818577 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f7aeb8f7-c218-4b82-942c-41e5a2cbd441 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:11.820065 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f7aeb8f7-c218-4b82-942c-41e5a2cbd441 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:11.986076 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f7aeb8f7-c218-4b82-942c-41e5a2cbd441 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:11.988600 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f7aeb8f7-c218-4b82-942c-41e5a2cbd441 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:11.994205 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f7aeb8f7-c218-4b82-942c-41e5a2cbd441 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:11.998901 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.objects.instance [None req-f7aeb8f7-c218-4b82-942c-41e5a2cbd441 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lazy-loading 'fault' on Instance uuid d2dd468e-d0ef-4e78-be7f-9756e469206d {{(pid=127171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:49:12.015462 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-148e3d12-4f74-4bf6-98bf-6e9cd9b7feaf tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:12.040587 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-148e3d12-4f74-4bf6-98bf-6e9cd9b7feaf tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.494533 Aug 31 09:49:12.057638 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 98/180] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:11 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:12.115335 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-f7aeb8f7-c218-4b82-942c-41e5a2cbd441 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae46122578a143a78f07f7f3a80ae079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb404a7dd529496888531e7ef00fd352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:12.132355 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-f7aeb8f7-c218-4b82-942c-41e5a2cbd441 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 200 len: 1351 microversion: 2.1 time: 0.387403 Aug 31 09:49:12.133956 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 83/181] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:11 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 1351 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:12.667946 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-8151b268-4266-4410-b17d-494f97561c2e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:12.668564 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-8151b268-4266-4410-b17d-494f97561c2e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:12.677017 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8151b268-4266-4410-b17d-494f97561c2e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:12.677533 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8151b268-4266-4410-b17d-494f97561c2e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:12.678137 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8151b268-4266-4410-b17d-494f97561c2e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:12.679057 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8151b268-4266-4410-b17d-494f97561c2e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:12.679512 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8151b268-4266-4410-b17d-494f97561c2e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:12.680122 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8151b268-4266-4410-b17d-494f97561c2e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:13.017566 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-8151b268-4266-4410-b17d-494f97561c2e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:13.031926 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-8151b268-4266-4410-b17d-494f97561c2e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91" status: 200 len: 1498 microversion: 2.1 time: 0.367436 Aug 31 09:49:13.034514 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 99/182] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:12 2022] GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91 => generated 1498 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:13.088562 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c1a9a203-bb12-4a4d-ade9-0780bd6ace02 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:13.097338 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c1a9a203-bb12-4a4d-ade9-0780bd6ace02 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:13.114124 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c1a9a203-bb12-4a4d-ade9-0780bd6ace02 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:13.114691 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c1a9a203-bb12-4a4d-ade9-0780bd6ace02 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:13.115264 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c1a9a203-bb12-4a4d-ade9-0780bd6ace02 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:13.116425 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c1a9a203-bb12-4a4d-ade9-0780bd6ace02 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:13.117213 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c1a9a203-bb12-4a4d-ade9-0780bd6ace02 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:13.129290 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c1a9a203-bb12-4a4d-ade9-0780bd6ace02 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:13.177305 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b3a90db2-ca62-4edd-b377-dbaeacfe5958 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:13.179204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b3a90db2-ca62-4edd-b377-dbaeacfe5958 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:13.210717 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b3a90db2-ca62-4edd-b377-dbaeacfe5958 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:13.212596 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b3a90db2-ca62-4edd-b377-dbaeacfe5958 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:13.222570 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b3a90db2-ca62-4edd-b377-dbaeacfe5958 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:13.223477 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b3a90db2-ca62-4edd-b377-dbaeacfe5958 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:13.223986 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b3a90db2-ca62-4edd-b377-dbaeacfe5958 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:13.224439 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b3a90db2-ca62-4edd-b377-dbaeacfe5958 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:13.256855 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-b3a90db2-ca62-4edd-b377-dbaeacfe5958 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] HTTP exception thrown: Instance d2dd468e-d0ef-4e78-be7f-9756e469206d could not be found. Aug 31 09:49:13.264284 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b3a90db2-ca62-4edd-b377-dbaeacfe5958 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Request method failure captured: Aug 31 09:49:13.264284 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d HTTP/1.1 Aug 31 09:49:13.264284 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 09:49:13.264284 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 09:49:13.264284 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 09:49:13.264284 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 09:49:13.264284 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 09:49:13.264284 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 09:49:13.264284 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 09:49:13.264284 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 09:49:13.264284 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy5TOy1LvtUGem3pC-1BeS6Xo0IlEx1xDYE6aa15h74wHdyQpwmobhJsadnIlsOs1udpjBG2vHGd2nMBRqVT71ltKZtYMgSdN3LOG-53yKlq0SaaMZTr_n_xoQFY-XVBEyEG5K-H34Aza4sFjImVuiu9ETblWQbCAOtLypomQCSF7HM Aug 31 09:49:13.264284 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 09:49:13.264284 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 09:49:13.264284 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 09:49:13.264284 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 09:49:13.264284 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 09:49:13.264284 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 09:49:13.264284 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: eb404a7dd529496888531e7ef00fd352 Aug 31 09:49:13.264284 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-DeleteServersTestJSON-1674345792 Aug 31 09:49:13.264284 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 09:49:13.264284 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 09:49:13.266001 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/eb404a7dd529496888531e7ef00fd352"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/eb404a7dd529496888531e7ef00fd352"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/eb404a7dd529496888531e7ef00fd352"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_eb404a7dd529496888531e7ef00fd352"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:49:13.266001 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-DeleteServersTestJSON-1674345792 Aug 31 09:49:13.266001 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: eb404a7dd529496888531e7ef00fd352 Aug 31 09:49:13.266001 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-DeleteServersTestJSON-1674345792 Aug 31 09:49:13.266001 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-DeleteServersTestJSON-1674345792-project Aug 31 09:49:13.266001 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 09:49:13.266001 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 09:49:13.266001 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: ae46122578a143a78f07f7f3a80ae079 Aug 31 09:49:13.266001 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-DeleteServersTestJSON-1674345792-project Aug 31 09:49:13.266001 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 09:49:13.266001 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Instance d2dd468e-d0ef-4e78-be7f-9756e469206d could not be found. Aug 31 09:49:13.266001 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': 'd2dd468e-d0ef-4e78-be7f-9756e469206d'} Aug 31 09:49:13.267172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:49:13.267172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:13.267172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:49:13.267172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:49:13.267172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:49:13.267172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:49:13.267172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:49:13.267172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:49:13.267172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:49:13.267172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:49:13.267172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2dd468e-d0ef-4e78-be7f-9756e469206d could not be found. Aug 31 09:49:13.267172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:49:13.267172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:49:13.267172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:49:13.267172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:13.267172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:49:13.267172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:49:13.267172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:49:13.267172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:49:13.267172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:49:13.269050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:49:13.269050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:49:13.269050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:49:13.269050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:49:13.269050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:49:13.269050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:49:13.269050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:49:13.269050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2dd468e-d0ef-4e78-be7f-9756e469206d could not be found. Aug 31 09:49:13.269050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:49:13.269050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:49:13.269050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:49:13.269050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:13.269050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:49:13.269050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:49:13.269050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:49:13.269050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:49:13.269050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2dd468e-d0ef-4e78-be7f-9756e469206d could not be found. Aug 31 09:49:13.269050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:49:13.272106 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b3a90db2-ca62-4edd-b377-dbaeacfe5958 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Returning 404 to user: Instance d2dd468e-d0ef-4e78-be7f-9756e469206d could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:49:13.273722 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b3a90db2-ca62-4edd-b377-dbaeacfe5958 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 404 len: 111 microversion: 2.1 time: 0.106933 Aug 31 09:49:13.274533 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 100/183] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:13 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:49:13.400379 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c1a9a203-bb12-4a4d-ade9-0780bd6ace02 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:13.410692 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c1a9a203-bb12-4a4d-ade9-0780bd6ace02 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.333159 Aug 31 09:49:13.412621 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 84/184] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:13 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:13.883564 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-0140d52f-4613-4460-8687-f4f76d40eb55 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:13.890867 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-0140d52f-4613-4460-8687-f4f76d40eb55 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:13.900011 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0140d52f-4613-4460-8687-f4f76d40eb55 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:13.900708 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0140d52f-4613-4460-8687-f4f76d40eb55 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:13.901308 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0140d52f-4613-4460-8687-f4f76d40eb55 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:13.901955 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0140d52f-4613-4460-8687-f4f76d40eb55 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:13.902319 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0140d52f-4613-4460-8687-f4f76d40eb55 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:13.902757 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0140d52f-4613-4460-8687-f4f76d40eb55 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:13.920380 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-0140d52f-4613-4460-8687-f4f76d40eb55 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] HTTP exception thrown: Instance d2dd468e-d0ef-4e78-be7f-9756e469206d could not be found. Aug 31 09:49:13.922204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-0140d52f-4613-4460-8687-f4f76d40eb55 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Request method failure captured: Aug 31 09:49:13.922204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d/os-volume_attachments HTTP/1.1 Aug 31 09:49:13.922204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 09:49:13.922204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 09:49:13.922204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 09:49:13.922204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 09:49:13.922204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 09:49:13.922204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 09:49:13.922204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 09:49:13.922204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 09:49:13.922204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy5TOy1LvtUGem3pC-1BeS6Xo0IlEx1xDYE6aa15h74wHdyQpwmobhJsadnIlsOs1udpjBG2vHGd2nMBRqVT71ltKZtYMgSdN3LOG-53yKlq0SaaMZTr_n_xoQFY-XVBEyEG5K-H34Aza4sFjImVuiu9ETblWQbCAOtLypomQCSF7HM Aug 31 09:49:13.922204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 09:49:13.922204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 09:49:13.922204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 09:49:13.922204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 09:49:13.922204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 09:49:13.922204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 09:49:13.922204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: eb404a7dd529496888531e7ef00fd352 Aug 31 09:49:13.922204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-DeleteServersTestJSON-1674345792 Aug 31 09:49:13.922204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 09:49:13.922204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 09:49:13.923911 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/eb404a7dd529496888531e7ef00fd352"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/eb404a7dd529496888531e7ef00fd352"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/eb404a7dd529496888531e7ef00fd352"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_eb404a7dd529496888531e7ef00fd352"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:49:13.923911 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-DeleteServersTestJSON-1674345792 Aug 31 09:49:13.923911 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: eb404a7dd529496888531e7ef00fd352 Aug 31 09:49:13.923911 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-DeleteServersTestJSON-1674345792 Aug 31 09:49:13.923911 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-DeleteServersTestJSON-1674345792-project Aug 31 09:49:13.923911 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 09:49:13.923911 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 09:49:13.923911 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: ae46122578a143a78f07f7f3a80ae079 Aug 31 09:49:13.923911 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-DeleteServersTestJSON-1674345792-project Aug 31 09:49:13.923911 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 09:49:13.923911 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Instance d2dd468e-d0ef-4e78-be7f-9756e469206d could not be found. Aug 31 09:49:13.923911 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'server_id': 'd2dd468e-d0ef-4e78-be7f-9756e469206d'} Aug 31 09:49:13.926018 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:49:13.926018 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:13.926018 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:49:13.926018 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:49:13.926018 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:49:13.926018 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:49:13.926018 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:49:13.926018 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:49:13.926018 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:49:13.926018 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:49:13.926018 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2dd468e-d0ef-4e78-be7f-9756e469206d could not be found. Aug 31 09:49:13.926018 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:49:13.926018 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:49:13.926018 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:49:13.926018 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:13.926018 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:49:13.926018 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:49:13.926018 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:49:13.926018 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:49:13.926018 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:49:13.928035 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:49:13.928035 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 09:49:13.928035 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:49:13.928035 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 09:49:13.928035 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:49:13.928035 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 31 09:49:13.928035 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 31 09:49:13.928035 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:49:13.928035 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:49:13.928035 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2dd468e-d0ef-4e78-be7f-9756e469206d could not be found. Aug 31 09:49:13.928035 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:49:13.928035 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:49:13.928035 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:49:13.928035 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:13.928035 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:49:13.928035 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:49:13.928035 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:49:13.928035 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:49:13.928035 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2dd468e-d0ef-4e78-be7f-9756e469206d could not be found. Aug 31 09:49:13.928035 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:49:13.929350 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-0140d52f-4613-4460-8687-f4f76d40eb55 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Returning 404 to user: Instance d2dd468e-d0ef-4e78-be7f-9756e469206d could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:49:13.929350 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-0140d52f-4613-4460-8687-f4f76d40eb55 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044280 Aug 31 09:49:13.929350 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 101/185] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 31 09:49:13 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d/os-volume_attachments => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:49:14.289855 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-4874799f-fdbb-4b39-9b9e-8aa920ecc279 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:14.290412 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-4874799f-fdbb-4b39-9b9e-8aa920ecc279 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:14.302517 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4874799f-fdbb-4b39-9b9e-8aa920ecc279 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:14.303032 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4874799f-fdbb-4b39-9b9e-8aa920ecc279 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:14.305874 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4874799f-fdbb-4b39-9b9e-8aa920ecc279 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:14.306754 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4874799f-fdbb-4b39-9b9e-8aa920ecc279 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:14.307644 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4874799f-fdbb-4b39-9b9e-8aa920ecc279 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:14.308165 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4874799f-fdbb-4b39-9b9e-8aa920ecc279 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:14.337693 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=100 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:14.352801 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-4874799f-fdbb-4b39-9b9e-8aa920ecc279 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] Going to try to terminate instance {{(pid=127171) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:49:14.450967 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-05c80314-b212-4614-90bf-8f746d3014df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:14.451704 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-05c80314-b212-4614-90bf-8f746d3014df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:14.462567 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-05c80314-b212-4614-90bf-8f746d3014df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:14.463144 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-05c80314-b212-4614-90bf-8f746d3014df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:14.463588 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-05c80314-b212-4614-90bf-8f746d3014df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:14.465959 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-05c80314-b212-4614-90bf-8f746d3014df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:14.466395 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-05c80314-b212-4614-90bf-8f746d3014df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:14.467343 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-05c80314-b212-4614-90bf-8f746d3014df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:14.502171 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-4874799f-fdbb-4b39-9b9e-8aa920ecc279 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91" status: 204 len: 0 microversion: 2.1 time: 0.216319 Aug 31 09:49:14.503457 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 85/186] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 09:49:14 2022] DELETE /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:49:14.517611 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-5272ef78-3cb5-4b49-b8e3-807fb73674ca tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:14.519608 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-5272ef78-3cb5-4b49-b8e3-807fb73674ca tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:14.526682 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5272ef78-3cb5-4b49-b8e3-807fb73674ca tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:14.527418 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5272ef78-3cb5-4b49-b8e3-807fb73674ca tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:14.528274 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5272ef78-3cb5-4b49-b8e3-807fb73674ca tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:14.529369 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5272ef78-3cb5-4b49-b8e3-807fb73674ca tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:14.530880 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5272ef78-3cb5-4b49-b8e3-807fb73674ca tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:14.531573 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5272ef78-3cb5-4b49-b8e3-807fb73674ca tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:14.803382 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-05c80314-b212-4614-90bf-8f746d3014df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:14.806025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:14.815867 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-5272ef78-3cb5-4b49-b8e3-807fb73674ca tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:14.820938 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-05c80314-b212-4614-90bf-8f746d3014df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.373493 Aug 31 09:49:14.823295 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 102/187] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:14 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:14.825305 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-5272ef78-3cb5-4b49-b8e3-807fb73674ca tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91" status: 200 len: 1504 microversion: 2.1 time: 0.313381 Aug 31 09:49:14.825962 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 86/188] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:14 2022] GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91 => generated 1504 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:15.420144 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-49466868-5928-40d1-9875-eb9cb60c1fa5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:15.420640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-49466868-5928-40d1-9875-eb9cb60c1fa5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:15.438414 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-49466868-5928-40d1-9875-eb9cb60c1fa5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:15.438896 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-49466868-5928-40d1-9875-eb9cb60c1fa5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:15.439561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-49466868-5928-40d1-9875-eb9cb60c1fa5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:15.440414 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-49466868-5928-40d1-9875-eb9cb60c1fa5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:15.441292 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-49466868-5928-40d1-9875-eb9cb60c1fa5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:15.441604 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-49466868-5928-40d1-9875-eb9cb60c1fa5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:15.461878 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-49466868-5928-40d1-9875-eb9cb60c1fa5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] HTTP exception thrown: Instance d2dd468e-d0ef-4e78-be7f-9756e469206d could not be found. Aug 31 09:49:15.464101 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-49466868-5928-40d1-9875-eb9cb60c1fa5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Request method failure captured: Aug 31 09:49:15.464101 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: DELETE /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d HTTP/1.1 Aug 31 09:49:15.464101 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 09:49:15.464101 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 09:49:15.464101 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 09:49:15.464101 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 09:49:15.464101 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 09:49:15.464101 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 09:49:15.464101 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 09:49:15.464101 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 09:49:15.464101 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy5TOy1LvtUGem3pC-1BeS6Xo0IlEx1xDYE6aa15h74wHdyQpwmobhJsadnIlsOs1udpjBG2vHGd2nMBRqVT71ltKZtYMgSdN3LOG-53yKlq0SaaMZTr_n_xoQFY-XVBEyEG5K-H34Aza4sFjImVuiu9ETblWQbCAOtLypomQCSF7HM Aug 31 09:49:15.464101 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 09:49:15.464101 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 09:49:15.464101 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 09:49:15.464101 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 09:49:15.464101 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 09:49:15.464101 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 09:49:15.464101 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: eb404a7dd529496888531e7ef00fd352 Aug 31 09:49:15.464101 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-DeleteServersTestJSON-1674345792 Aug 31 09:49:15.464101 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 09:49:15.464101 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 09:49:15.466084 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/eb404a7dd529496888531e7ef00fd352"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/eb404a7dd529496888531e7ef00fd352"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/eb404a7dd529496888531e7ef00fd352"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_eb404a7dd529496888531e7ef00fd352"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:49:15.466084 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-DeleteServersTestJSON-1674345792 Aug 31 09:49:15.466084 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: eb404a7dd529496888531e7ef00fd352 Aug 31 09:49:15.466084 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-DeleteServersTestJSON-1674345792 Aug 31 09:49:15.466084 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-DeleteServersTestJSON-1674345792-project Aug 31 09:49:15.466084 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 09:49:15.466084 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 09:49:15.466084 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: ae46122578a143a78f07f7f3a80ae079 Aug 31 09:49:15.466084 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-DeleteServersTestJSON-1674345792-project Aug 31 09:49:15.466084 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 09:49:15.466084 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Instance d2dd468e-d0ef-4e78-be7f-9756e469206d could not be found. Aug 31 09:49:15.466084 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': 'd2dd468e-d0ef-4e78-be7f-9756e469206d'} Aug 31 09:49:15.466915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:49:15.466915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:15.466915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:49:15.466915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:49:15.466915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:49:15.466915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:49:15.466915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:49:15.466915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:49:15.466915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:49:15.466915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:49:15.466915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2dd468e-d0ef-4e78-be7f-9756e469206d could not be found. Aug 31 09:49:15.466915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:49:15.466915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:49:15.466915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:49:15.466915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:15.466915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:49:15.466915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:49:15.466915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:49:15.466915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:49:15.466915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:49:15.470322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:49:15.470322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 09:49:15.470322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 09:49:15.470322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 09:49:15.470322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 09:49:15.470322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:49:15.470322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:49:15.470322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:49:15.470322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:49:15.470322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2dd468e-d0ef-4e78-be7f-9756e469206d could not be found. Aug 31 09:49:15.470322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:49:15.470322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:49:15.470322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:49:15.470322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:15.470322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:49:15.470322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:49:15.470322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:49:15.470322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:49:15.470322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2dd468e-d0ef-4e78-be7f-9756e469206d could not be found. Aug 31 09:49:15.470322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:49:15.472295 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-49466868-5928-40d1-9875-eb9cb60c1fa5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Returning 404 to user: Instance d2dd468e-d0ef-4e78-be7f-9756e469206d could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:49:15.472295 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-49466868-5928-40d1-9875-eb9cb60c1fa5 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 404 len: 111 microversion: 2.1 time: 0.050656 Aug 31 09:49:15.472295 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 103/189] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 09:49:15 2022] DELETE /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:49:15.476606 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-d5b7b52b-30ca-4ac4-9945-db59147c76b1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:15.477227 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-d5b7b52b-30ca-4ac4-9945-db59147c76b1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] [instance: d2dd468e-d0ef-4e78-be7f-9756e469206d] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:15.484987 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d5b7b52b-30ca-4ac4-9945-db59147c76b1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:15.485501 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d5b7b52b-30ca-4ac4-9945-db59147c76b1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:15.485943 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d5b7b52b-30ca-4ac4-9945-db59147c76b1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:15.487223 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d5b7b52b-30ca-4ac4-9945-db59147c76b1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:15.488095 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d5b7b52b-30ca-4ac4-9945-db59147c76b1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:15.488643 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d5b7b52b-30ca-4ac4-9945-db59147c76b1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:15.510780 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.wsgi [None req-d5b7b52b-30ca-4ac4-9945-db59147c76b1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] HTTP exception thrown: Instance d2dd468e-d0ef-4e78-be7f-9756e469206d could not be found. Aug 31 09:49:15.516275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-d5b7b52b-30ca-4ac4-9945-db59147c76b1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Request method failure captured: Aug 31 09:49:15.516275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: request: GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d HTTP/1.1 Aug 31 09:49:15.516275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept: application/json Aug 31 09:49:15.516275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept-Encoding: identity Aug 31 09:49:15.516275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Connection: close Aug 31 09:49:15.516275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Length: 0 Aug 31 09:49:15.516275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Type: application/json Aug 31 09:49:15.516275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Host: 10.222.0.13 Aug 31 09:49:15.516275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Openstack-System-Scope: None Aug 31 09:49:15.516275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: User-Agent: python-urllib3/1.26.12 Aug 31 09:49:15.516275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Auth-Token: gAAAAABjDy5TOy1LvtUGem3pC-1BeS6Xo0IlEx1xDYE6aa15h74wHdyQpwmobhJsadnIlsOs1udpjBG2vHGd2nMBRqVT71ltKZtYMgSdN3LOG-53yKlq0SaaMZTr_n_xoQFY-XVBEyEG5K-H34Aza4sFjImVuiu9ETblWQbCAOtLypomQCSF7HM Aug 31 09:49:15.516275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Id: None Aug 31 09:49:15.516275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Name: None Aug 31 09:49:15.516275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Identity-Status: Confirmed Aug 31 09:49:15.516275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Is-Admin-Project: True Aug 31 09:49:15.516275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Id: default Aug 31 09:49:15.516275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Name: Default Aug 31 09:49:15.516275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Id: eb404a7dd529496888531e7ef00fd352 Aug 31 09:49:15.516275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Name: tempest-DeleteServersTestJSON-1674345792 Aug 31 09:49:15.516275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Role: member,reader Aug 31 09:49:15.516275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Roles: member,reader Aug 31 09:49:15.517511 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/eb404a7dd529496888531e7ef00fd352"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/eb404a7dd529496888531e7ef00fd352"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/eb404a7dd529496888531e7ef00fd352"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_eb404a7dd529496888531e7ef00fd352"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:49:15.517511 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant: tempest-DeleteServersTestJSON-1674345792 Aug 31 09:49:15.517511 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Id: eb404a7dd529496888531e7ef00fd352 Aug 31 09:49:15.517511 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Name: tempest-DeleteServersTestJSON-1674345792 Aug 31 09:49:15.517511 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User: tempest-DeleteServersTestJSON-1674345792-project Aug 31 09:49:15.517511 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Id: default Aug 31 09:49:15.517511 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Name: Default Aug 31 09:49:15.517511 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Id: ae46122578a143a78f07f7f3a80ae079 Aug 31 09:49:15.517511 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Name: tempest-DeleteServersTestJSON-1674345792-project Aug 31 09:49:15.517511 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: method: > Aug 31 09:49:15.517511 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: exception: Instance d2dd468e-d0ef-4e78-be7f-9756e469206d could not be found. Aug 31 09:49:15.517511 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: action_args: {'id': 'd2dd468e-d0ef-4e78-be7f-9756e469206d'} Aug 31 09:49:15.518197 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:49:15.518197 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:15.518197 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:49:15.518197 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:49:15.518197 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:49:15.518197 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:49:15.518197 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:49:15.518197 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:49:15.518197 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:49:15.518197 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:49:15.518197 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2dd468e-d0ef-4e78-be7f-9756e469206d could not be found. Aug 31 09:49:15.518197 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:49:15.518197 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:49:15.518197 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:49:15.518197 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:15.518197 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:49:15.518197 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:49:15.518197 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:49:15.518197 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:49:15.518197 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:49:15.519594 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:49:15.519594 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:49:15.519594 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:49:15.519594 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:49:15.519594 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:49:15.519594 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:49:15.519594 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:49:15.519594 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2dd468e-d0ef-4e78-be7f-9756e469206d could not be found. Aug 31 09:49:15.519594 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:49:15.519594 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:49:15.519594 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:49:15.519594 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:15.519594 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:49:15.519594 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:49:15.519594 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:49:15.519594 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:49:15.519594 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2dd468e-d0ef-4e78-be7f-9756e469206d could not be found. Aug 31 09:49:15.519594 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:49:15.520558 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-d5b7b52b-30ca-4ac4-9945-db59147c76b1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] Returning 404 to user: Instance d2dd468e-d0ef-4e78-be7f-9756e469206d could not be found. {{(pid=127171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:49:15.520558 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-d5b7b52b-30ca-4ac4-9945-db59147c76b1 tempest-DeleteServersTestJSON-1674345792 tempest-DeleteServersTestJSON-1674345792-project] 10.222.0.13 "GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d" status: 404 len: 111 microversion: 2.1 time: 0.046960 Aug 31 09:49:15.522014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 87/190] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:15 2022] GET /compute/v2.1/servers/d2dd468e-d0ef-4e78-be7f-9756e469206d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 09:49:15.852551 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-6ccdae2b-a67d-4590-bb6e-f0eb0cf5faca tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:15.853574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-6ccdae2b-a67d-4590-bb6e-f0eb0cf5faca tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:15.861736 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-ebcb49d3-373e-456d-a249-e6fb7c4542a3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:15.864241 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-ebcb49d3-373e-456d-a249-e6fb7c4542a3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:15.877430 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ccdae2b-a67d-4590-bb6e-f0eb0cf5faca tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:15.878264 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ccdae2b-a67d-4590-bb6e-f0eb0cf5faca tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:15.878754 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ccdae2b-a67d-4590-bb6e-f0eb0cf5faca tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:15.879545 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ccdae2b-a67d-4590-bb6e-f0eb0cf5faca tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:15.880009 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ccdae2b-a67d-4590-bb6e-f0eb0cf5faca tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:15.880426 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ccdae2b-a67d-4590-bb6e-f0eb0cf5faca tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:15.893508 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ebcb49d3-373e-456d-a249-e6fb7c4542a3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:15.896671 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ebcb49d3-373e-456d-a249-e6fb7c4542a3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:15.900984 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ebcb49d3-373e-456d-a249-e6fb7c4542a3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:15.905496 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ebcb49d3-373e-456d-a249-e6fb7c4542a3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:15.906990 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ebcb49d3-373e-456d-a249-e6fb7c4542a3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:15.907974 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ebcb49d3-373e-456d-a249-e6fb7c4542a3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:16.348295 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-6ccdae2b-a67d-4590-bb6e-f0eb0cf5faca tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:16.382046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-6ccdae2b-a67d-4590-bb6e-f0eb0cf5faca tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91" status: 200 len: 1504 microversion: 2.1 time: 0.536951 Aug 31 09:49:16.383647 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 104/191] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:15 2022] GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91 => generated 1504 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:16.398304 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-ebcb49d3-373e-456d-a249-e6fb7c4542a3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:16.426565 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-ebcb49d3-373e-456d-a249-e6fb7c4542a3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.569664 Aug 31 09:49:16.430756 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 88/192] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:15 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:17.429952 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-5dd7cfab-84e6-4f4d-b728-bbf4edaed1b0 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:17.433281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-5dd7cfab-84e6-4f4d-b728-bbf4edaed1b0 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:17.456911 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-a7d5cccb-dc35-41c0-b822-bee1b6f854fc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:17.458063 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-a7d5cccb-dc35-41c0-b822-bee1b6f854fc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:17.466566 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5dd7cfab-84e6-4f4d-b728-bbf4edaed1b0 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:17.468410 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5dd7cfab-84e6-4f4d-b728-bbf4edaed1b0 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:17.469654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5dd7cfab-84e6-4f4d-b728-bbf4edaed1b0 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:17.471051 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5dd7cfab-84e6-4f4d-b728-bbf4edaed1b0 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:17.474364 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5dd7cfab-84e6-4f4d-b728-bbf4edaed1b0 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:17.475156 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a7d5cccb-dc35-41c0-b822-bee1b6f854fc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:17.475584 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5dd7cfab-84e6-4f4d-b728-bbf4edaed1b0 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:17.476338 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a7d5cccb-dc35-41c0-b822-bee1b6f854fc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:17.477563 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a7d5cccb-dc35-41c0-b822-bee1b6f854fc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:17.479505 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a7d5cccb-dc35-41c0-b822-bee1b6f854fc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:17.480581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a7d5cccb-dc35-41c0-b822-bee1b6f854fc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:17.495294 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a7d5cccb-dc35-41c0-b822-bee1b6f854fc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:18.089119 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-5dd7cfab-84e6-4f4d-b728-bbf4edaed1b0 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:18.101631 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-5dd7cfab-84e6-4f4d-b728-bbf4edaed1b0 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91" status: 200 len: 1504 microversion: 2.1 time: 0.683875 Aug 31 09:49:18.114377 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 105/193] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:17 2022] GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91 => generated 1504 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:18.139872 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-a7d5cccb-dc35-41c0-b822-bee1b6f854fc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:18.153184 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-a7d5cccb-dc35-41c0-b822-bee1b6f854fc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.703930 Aug 31 09:49:18.155091 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 89/194] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:17 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:18.780578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-c531e540-ad9e-46a0-b7cb-7128a68cc01d req-45f50d5d-7828-4e3c-a4d5-3e5b374a8bda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c8d616-8c5b-4060-ac1f-1386107a7f91", "name": "network-vif-deleted", "tag": "b2ed2dcc-e09a-4bc1-a617-4e0573eb3d3d"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:18.796740 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-c531e540-ad9e-46a0-b7cb-7128a68cc01d req-45f50d5d-7828-4e3c-a4d5-3e5b374a8bda service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:18.797523 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-c531e540-ad9e-46a0-b7cb-7128a68cc01d req-45f50d5d-7828-4e3c-a4d5-3e5b374a8bda service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:18.798097 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-c531e540-ad9e-46a0-b7cb-7128a68cc01d req-45f50d5d-7828-4e3c-a4d5-3e5b374a8bda service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:18.815510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-c531e540-ad9e-46a0-b7cb-7128a68cc01d req-45f50d5d-7828-4e3c-a4d5-3e5b374a8bda service nova] Creating event network-vif-deleted:b2ed2dcc-e09a-4bc1-a617-4e0573eb3d3d for instance b9c8d616-8c5b-4060-ac1f-1386107a7f91 on hv-cinder-84496 Aug 31 09:49:18.822917 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-c531e540-ad9e-46a0-b7cb-7128a68cc01d req-45f50d5d-7828-4e3c-a4d5-3e5b374a8bda service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046033 Aug 31 09:49:18.824338 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 106/195] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:19.128355 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-d66ca0a2-86b0-4ee0-b426-8f182443b014 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:19.131700 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-d66ca0a2-86b0-4ee0-b426-8f182443b014 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:19.143922 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d66ca0a2-86b0-4ee0-b426-8f182443b014 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:19.144658 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d66ca0a2-86b0-4ee0-b426-8f182443b014 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:19.145316 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d66ca0a2-86b0-4ee0-b426-8f182443b014 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:19.148422 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d66ca0a2-86b0-4ee0-b426-8f182443b014 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:19.151889 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d66ca0a2-86b0-4ee0-b426-8f182443b014 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:19.152833 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d66ca0a2-86b0-4ee0-b426-8f182443b014 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:19.194203 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-abe43d68-de33-40cb-a3ea-0774c5d41ca9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:19.197752 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-abe43d68-de33-40cb-a3ea-0774c5d41ca9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:19.245524 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-abe43d68-de33-40cb-a3ea-0774c5d41ca9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:19.249026 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-abe43d68-de33-40cb-a3ea-0774c5d41ca9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:19.268804 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-abe43d68-de33-40cb-a3ea-0774c5d41ca9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:19.271547 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-abe43d68-de33-40cb-a3ea-0774c5d41ca9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:19.274026 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-abe43d68-de33-40cb-a3ea-0774c5d41ca9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:19.275310 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-abe43d68-de33-40cb-a3ea-0774c5d41ca9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:19.285185 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d66ca0a2-86b0-4ee0-b426-8f182443b014 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:19.290805 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d66ca0a2-86b0-4ee0-b426-8f182443b014 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:19.291861 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d66ca0a2-86b0-4ee0-b426-8f182443b014 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:19.294212 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.objects.instance [None req-d66ca0a2-86b0-4ee0-b426-8f182443b014 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lazy-loading 'fault' on Instance uuid b9c8d616-8c5b-4060-ac1f-1386107a7f91 {{(pid=127171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:49:19.460918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-d66ca0a2-86b0-4ee0-b426-8f182443b014 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:19.475470 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-d66ca0a2-86b0-4ee0-b426-8f182443b014 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91" status: 200 len: 1304 microversion: 2.1 time: 0.352893 Aug 31 09:49:19.477565 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 90/196] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:19 2022] GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91 => generated 1304 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:19.722683 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-abe43d68-de33-40cb-a3ea-0774c5d41ca9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:19.735906 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-abe43d68-de33-40cb-a3ea-0774c5d41ca9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.554394 Aug 31 09:49:19.741451 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 107/197] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:19 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:20.509967 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-89d19e35-7e33-47b2-aab4-0d908629a514 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:20.511327 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-89d19e35-7e33-47b2-aab4-0d908629a514 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:20.522451 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-89d19e35-7e33-47b2-aab4-0d908629a514 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:20.528161 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-89d19e35-7e33-47b2-aab4-0d908629a514 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:20.532676 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-89d19e35-7e33-47b2-aab4-0d908629a514 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:20.535397 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-89d19e35-7e33-47b2-aab4-0d908629a514 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:20.543077 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-89d19e35-7e33-47b2-aab4-0d908629a514 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:20.545297 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-89d19e35-7e33-47b2-aab4-0d908629a514 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:20.624987 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-89d19e35-7e33-47b2-aab4-0d908629a514 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:20.632163 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-89d19e35-7e33-47b2-aab4-0d908629a514 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:20.634212 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-89d19e35-7e33-47b2-aab4-0d908629a514 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:20.634707 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.objects.instance [None req-89d19e35-7e33-47b2-aab4-0d908629a514 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lazy-loading 'fault' on Instance uuid b9c8d616-8c5b-4060-ac1f-1386107a7f91 {{(pid=127171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:49:20.771697 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-4ac27f08-e97a-4148-ae74-e86edc58eeaa tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:20.773028 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-4ac27f08-e97a-4148-ae74-e86edc58eeaa tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:20.782235 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4ac27f08-e97a-4148-ae74-e86edc58eeaa tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:20.784216 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4ac27f08-e97a-4148-ae74-e86edc58eeaa tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:20.785066 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4ac27f08-e97a-4148-ae74-e86edc58eeaa tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:20.785913 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-89d19e35-7e33-47b2-aab4-0d908629a514 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:20.786331 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4ac27f08-e97a-4148-ae74-e86edc58eeaa tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:20.787008 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4ac27f08-e97a-4148-ae74-e86edc58eeaa tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:20.788177 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4ac27f08-e97a-4148-ae74-e86edc58eeaa tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:20.813727 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-89d19e35-7e33-47b2-aab4-0d908629a514 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91" status: 200 len: 1304 microversion: 2.1 time: 0.307224 Aug 31 09:49:20.819905 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 91/198] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:20 2022] GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91 => generated 1304 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:21.041860 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-4ac27f08-e97a-4148-ae74-e86edc58eeaa tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:21.063591 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-4ac27f08-e97a-4148-ae74-e86edc58eeaa tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.296413 Aug 31 09:49:21.066935 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 108/199] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:20 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:21.853008 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-7f25ef16-f6eb-49af-b932-4325a338aa86 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:21.854749 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-7f25ef16-f6eb-49af-b932-4325a338aa86 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:21.861847 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7f25ef16-f6eb-49af-b932-4325a338aa86 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:21.862795 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7f25ef16-f6eb-49af-b932-4325a338aa86 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:21.863470 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7f25ef16-f6eb-49af-b932-4325a338aa86 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:21.864250 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7f25ef16-f6eb-49af-b932-4325a338aa86 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:21.864929 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7f25ef16-f6eb-49af-b932-4325a338aa86 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:21.865569 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7f25ef16-f6eb-49af-b932-4325a338aa86 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:21.902258 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7f25ef16-f6eb-49af-b932-4325a338aa86 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:21.903118 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7f25ef16-f6eb-49af-b932-4325a338aa86 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:21.903757 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7f25ef16-f6eb-49af-b932-4325a338aa86 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:21.904412 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.objects.instance [None req-7f25ef16-f6eb-49af-b932-4325a338aa86 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lazy-loading 'fault' on Instance uuid b9c8d616-8c5b-4060-ac1f-1386107a7f91 {{(pid=127171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:49:21.964623 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7f25ef16-f6eb-49af-b932-4325a338aa86 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:21.984732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-7f25ef16-f6eb-49af-b932-4325a338aa86 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91" status: 200 len: 1304 microversion: 2.1 time: 0.135201 Aug 31 09:49:21.985941 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 92/200] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:21 2022] GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91 => generated 1304 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:22.100286 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-69a8acaa-ba90-41e2-b330-68a60b3fc12f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:22.103207 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-69a8acaa-ba90-41e2-b330-68a60b3fc12f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:22.125281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-69a8acaa-ba90-41e2-b330-68a60b3fc12f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:22.130885 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-69a8acaa-ba90-41e2-b330-68a60b3fc12f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:22.132457 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-69a8acaa-ba90-41e2-b330-68a60b3fc12f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:22.140102 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-69a8acaa-ba90-41e2-b330-68a60b3fc12f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:22.141057 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-69a8acaa-ba90-41e2-b330-68a60b3fc12f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:22.141852 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-69a8acaa-ba90-41e2-b330-68a60b3fc12f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:22.638999 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-69a8acaa-ba90-41e2-b330-68a60b3fc12f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:22.682413 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-69a8acaa-ba90-41e2-b330-68a60b3fc12f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.592029 Aug 31 09:49:22.709912 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 109/201] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:22 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:23.028554 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-55a26499-1c9c-4716-a9ff-6c13339b987c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:23.029308 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-55a26499-1c9c-4716-a9ff-6c13339b987c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:23.051787 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-55a26499-1c9c-4716-a9ff-6c13339b987c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:23.052589 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-55a26499-1c9c-4716-a9ff-6c13339b987c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:23.053189 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-55a26499-1c9c-4716-a9ff-6c13339b987c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:23.054740 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-55a26499-1c9c-4716-a9ff-6c13339b987c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:23.055732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-55a26499-1c9c-4716-a9ff-6c13339b987c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:23.056457 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-55a26499-1c9c-4716-a9ff-6c13339b987c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:23.178968 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-55a26499-1c9c-4716-a9ff-6c13339b987c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:23.179461 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-55a26499-1c9c-4716-a9ff-6c13339b987c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:23.179893 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-55a26499-1c9c-4716-a9ff-6c13339b987c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:23.180336 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.objects.instance [None req-55a26499-1c9c-4716-a9ff-6c13339b987c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lazy-loading 'fault' on Instance uuid b9c8d616-8c5b-4060-ac1f-1386107a7f91 {{(pid=127171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:49:23.280981 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-55a26499-1c9c-4716-a9ff-6c13339b987c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:23.334291 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-55a26499-1c9c-4716-a9ff-6c13339b987c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91" status: 200 len: 1304 microversion: 2.1 time: 0.309311 Aug 31 09:49:23.344482 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 93/202] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:23 2022] GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91 => generated 1304 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:23.743246 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b4f86742-4c54-44b4-8df1-ae3ec7cbd06a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:23.744378 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b4f86742-4c54-44b4-8df1-ae3ec7cbd06a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:23.756326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b4f86742-4c54-44b4-8df1-ae3ec7cbd06a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:23.757609 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b4f86742-4c54-44b4-8df1-ae3ec7cbd06a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:23.758371 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b4f86742-4c54-44b4-8df1-ae3ec7cbd06a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:23.759748 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b4f86742-4c54-44b4-8df1-ae3ec7cbd06a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:23.760378 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b4f86742-4c54-44b4-8df1-ae3ec7cbd06a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:23.761577 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b4f86742-4c54-44b4-8df1-ae3ec7cbd06a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:24.082056 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b4f86742-4c54-44b4-8df1-ae3ec7cbd06a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:24.093040 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b4f86742-4c54-44b4-8df1-ae3ec7cbd06a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.357057 Aug 31 09:49:24.093861 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 110/203] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:23 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:24.388575 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-225b1ef7-3e0d-4d05-bc81-6c65f715f988 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:24.389490 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-225b1ef7-3e0d-4d05-bc81-6c65f715f988 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:24.400433 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-225b1ef7-3e0d-4d05-bc81-6c65f715f988 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:24.401138 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-225b1ef7-3e0d-4d05-bc81-6c65f715f988 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:24.401771 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-225b1ef7-3e0d-4d05-bc81-6c65f715f988 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:24.402558 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-225b1ef7-3e0d-4d05-bc81-6c65f715f988 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:24.403081 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-225b1ef7-3e0d-4d05-bc81-6c65f715f988 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:24.403925 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-225b1ef7-3e0d-4d05-bc81-6c65f715f988 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:24.469588 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-225b1ef7-3e0d-4d05-bc81-6c65f715f988 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:24.470441 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-225b1ef7-3e0d-4d05-bc81-6c65f715f988 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:24.471417 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-225b1ef7-3e0d-4d05-bc81-6c65f715f988 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:24.472494 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.objects.instance [None req-225b1ef7-3e0d-4d05-bc81-6c65f715f988 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lazy-loading 'fault' on Instance uuid b9c8d616-8c5b-4060-ac1f-1386107a7f91 {{(pid=127171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:49:24.665689 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-225b1ef7-3e0d-4d05-bc81-6c65f715f988 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:24.686106 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-225b1ef7-3e0d-4d05-bc81-6c65f715f988 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91" status: 200 len: 1304 microversion: 2.1 time: 0.304092 Aug 31 09:49:24.687540 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 94/204] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:24 2022] GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91 => generated 1304 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:25.137914 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-6ff214f5-2676-4d57-a833-38c41fa8e03f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:25.139336 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-6ff214f5-2676-4d57-a833-38c41fa8e03f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:25.151413 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ff214f5-2676-4d57-a833-38c41fa8e03f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:25.152405 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ff214f5-2676-4d57-a833-38c41fa8e03f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:25.153025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ff214f5-2676-4d57-a833-38c41fa8e03f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:25.154818 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ff214f5-2676-4d57-a833-38c41fa8e03f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:25.156215 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ff214f5-2676-4d57-a833-38c41fa8e03f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:25.157422 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ff214f5-2676-4d57-a833-38c41fa8e03f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:25.350899 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-6ff214f5-2676-4d57-a833-38c41fa8e03f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:25.367813 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-6ff214f5-2676-4d57-a833-38c41fa8e03f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.239470 Aug 31 09:49:25.369091 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 111/205] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:25 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:25.721406 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c5b22228-00b9-43be-9b98-59b72bee8371 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:25.722269 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c5b22228-00b9-43be-9b98-59b72bee8371 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: b9c8d616-8c5b-4060-ac1f-1386107a7f91] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:25.729744 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c5b22228-00b9-43be-9b98-59b72bee8371 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:25.730233 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c5b22228-00b9-43be-9b98-59b72bee8371 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:25.730663 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c5b22228-00b9-43be-9b98-59b72bee8371 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:25.731374 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c5b22228-00b9-43be-9b98-59b72bee8371 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:25.731821 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c5b22228-00b9-43be-9b98-59b72bee8371 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:25.732274 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c5b22228-00b9-43be-9b98-59b72bee8371 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:25.747089 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.wsgi [None req-c5b22228-00b9-43be-9b98-59b72bee8371 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] HTTP exception thrown: Instance b9c8d616-8c5b-4060-ac1f-1386107a7f91 could not be found. Aug 31 09:49:25.748640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c5b22228-00b9-43be-9b98-59b72bee8371 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Request method failure captured: Aug 31 09:49:25.748640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: request: GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91 HTTP/1.1 Aug 31 09:49:25.748640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept: application/json Aug 31 09:49:25.748640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept-Encoding: identity Aug 31 09:49:25.748640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Connection: close Aug 31 09:49:25.748640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Length: 0 Aug 31 09:49:25.748640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Type: application/json Aug 31 09:49:25.748640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Host: 10.222.0.13 Aug 31 09:49:25.748640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Openstack-System-Scope: None Aug 31 09:49:25.748640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: User-Agent: python-urllib3/1.26.12 Aug 31 09:49:25.748640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Auth-Token: gAAAAABjDy5-Ti3iNCUi4f5Nq14mKNGMilPkU2PoerTQvpVOp8jCeaDMWajEGEfqRyX7vUT8WGQklWx0VNMSLBa4ZDJIK_PIeohCkvoSfJI-KR05mbpaYjWxZZuAXX2QvYcTgsvaVAgdg_E8ArKQFJOvV8QrMxN-zDfZFtm73zwskwDMUK7LedE Aug 31 09:49:25.748640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Id: None Aug 31 09:49:25.748640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Name: None Aug 31 09:49:25.748640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Identity-Status: Confirmed Aug 31 09:49:25.748640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Is-Admin-Project: True Aug 31 09:49:25.748640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Id: default Aug 31 09:49:25.748640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Name: Default Aug 31 09:49:25.748640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Id: 0d7d52f95e5e452ca2ac11900fc0d931 Aug 31 09:49:25.748640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Name: tempest-VolumesActionsTest-1540542713 Aug 31 09:49:25.748640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Role: member,reader Aug 31 09:49:25.748640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Roles: member,reader Aug 31 09:49:25.751288 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0d7d52f95e5e452ca2ac11900fc0d931"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0d7d52f95e5e452ca2ac11900fc0d931"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0d7d52f95e5e452ca2ac11900fc0d931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0d7d52f95e5e452ca2ac11900fc0d931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:49:25.751288 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant: tempest-VolumesActionsTest-1540542713 Aug 31 09:49:25.751288 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Id: 0d7d52f95e5e452ca2ac11900fc0d931 Aug 31 09:49:25.751288 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Name: tempest-VolumesActionsTest-1540542713 Aug 31 09:49:25.751288 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User: tempest-VolumesActionsTest-1540542713-project Aug 31 09:49:25.751288 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Id: default Aug 31 09:49:25.751288 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Name: Default Aug 31 09:49:25.751288 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Id: c475984de9e84ff18fb96c588a07c80b Aug 31 09:49:25.751288 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Name: tempest-VolumesActionsTest-1540542713-project Aug 31 09:49:25.751288 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: method: > Aug 31 09:49:25.751288 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: exception: Instance b9c8d616-8c5b-4060-ac1f-1386107a7f91 could not be found. Aug 31 09:49:25.751288 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: action_args: {'id': 'b9c8d616-8c5b-4060-ac1f-1386107a7f91'} Aug 31 09:49:25.753408 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:49:25.753408 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:25.753408 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:49:25.753408 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:49:25.753408 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:49:25.753408 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:49:25.753408 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:49:25.753408 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:49:25.753408 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:49:25.753408 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:49:25.753408 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9c8d616-8c5b-4060-ac1f-1386107a7f91 could not be found. Aug 31 09:49:25.753408 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:49:25.753408 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:49:25.753408 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:49:25.753408 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:25.753408 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:49:25.753408 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:49:25.753408 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:49:25.753408 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:49:25.753408 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:49:25.756176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:49:25.756176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:49:25.756176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:49:25.756176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:49:25.756176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:49:25.756176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:49:25.756176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:49:25.756176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9c8d616-8c5b-4060-ac1f-1386107a7f91 could not be found. Aug 31 09:49:25.756176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:49:25.756176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:49:25.756176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:49:25.756176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:25.756176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:49:25.756176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:49:25.756176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:49:25.756176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:49:25.756176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9c8d616-8c5b-4060-ac1f-1386107a7f91 could not be found. Aug 31 09:49:25.756176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:49:25.760201 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c5b22228-00b9-43be-9b98-59b72bee8371 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Returning 404 to user: Instance b9c8d616-8c5b-4060-ac1f-1386107a7f91 could not be found. {{(pid=127171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:49:25.760201 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c5b22228-00b9-43be-9b98-59b72bee8371 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91" status: 404 len: 111 microversion: 2.1 time: 0.033687 Aug 31 09:49:25.760201 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 95/206] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:25 2022] GET /compute/v2.1/servers/b9c8d616-8c5b-4060-ac1f-1386107a7f91 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:49:25.912765 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-18467760-dec8-4b89-9e97-76322c451658 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1584543765", "imageRef": "8e078bb9-f274-4984-8128-d31407d49604", "flavorRef": "452", "networks": [{"uuid": "9aad165a-e9a5-4348-86e8-f13640f54588"}]}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:25.991257 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.network.neutron [None req-18467760-dec8-4b89-9e97-76322c451658 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] validate_networks() for [('9aad165a-e9a5-4348-86e8-f13640f54588', None, None, None, None, None)] {{(pid=127170) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:49:26.410307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-2547160f-0a33-4253-af22-7371a3ffaaab tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:26.413267 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-2547160f-0a33-4253-af22-7371a3ffaaab tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:26.432075 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2547160f-0a33-4253-af22-7371a3ffaaab tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:26.433618 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2547160f-0a33-4253-af22-7371a3ffaaab tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:26.435015 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2547160f-0a33-4253-af22-7371a3ffaaab tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:26.436722 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2547160f-0a33-4253-af22-7371a3ffaaab tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:26.437942 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2547160f-0a33-4253-af22-7371a3ffaaab tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:26.439143 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2547160f-0a33-4253-af22-7371a3ffaaab tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:26.868880 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-18467760-dec8-4b89-9e97-76322c451658 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Flavor limits 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:49:26.870866 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-18467760-dec8-4b89-9e97-76322c451658 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Image limits 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:49:26.872682 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-18467760-dec8-4b89-9e97-76322c451658 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Flavor pref 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:49:26.875331 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-18467760-dec8-4b89-9e97-76322c451658 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Image pref 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:49:26.878405 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-18467760-dec8-4b89-9e97-76322c451658 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:49:26.931164 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-18467760-dec8-4b89-9e97-76322c451658 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:26.932184 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-18467760-dec8-4b89-9e97-76322c451658 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:26.932365 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2547160f-0a33-4253-af22-7371a3ffaaab tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:26.936872 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-18467760-dec8-4b89-9e97-76322c451658 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:26.940435 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-18467760-dec8-4b89-9e97-76322c451658 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:26.946202 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-18467760-dec8-4b89-9e97-76322c451658 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:26.947956 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-2547160f-0a33-4253-af22-7371a3ffaaab tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.545253 Aug 31 09:49:26.948990 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-18467760-dec8-4b89-9e97-76322c451658 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:26.953007 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 96/207] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:26 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:26.991515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-18467760-dec8-4b89-9e97-76322c451658 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Getting quotas for project 0d7d52f95e5e452ca2ac11900fc0d931. Resources: {'ram', 'instances', 'cores'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:49:26.997041 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-18467760-dec8-4b89-9e97-76322c451658 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Getting quotas for user c475984de9e84ff18fb96c588a07c80b and project 0d7d52f95e5e452ca2ac11900fc0d931. Resources: {'ram', 'instances', 'cores'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:49:27.021079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-18467760-dec8-4b89-9e97-76322c451658 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Going to run 1 instances... {{(pid=127170) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:49:27.027307 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-18467760-dec8-4b89-9e97-76322c451658 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8e078bb9-f274-4984-8128-d31407d49604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:49:27.138695 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-18467760-dec8-4b89-9e97-76322c451658 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.229526 Aug 31 09:49:27.140237 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 112/208] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 31 09:49:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:49:27.159854 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-ad358765-82b5-4b21-832c-eaa3b0477d54 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:27.161107 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-ad358765-82b5-4b21-832c-eaa3b0477d54 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:27.172096 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:27.285579 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-ad358765-82b5-4b21-832c-eaa3b0477d54 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:27.301629 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-ad358765-82b5-4b21-832c-eaa3b0477d54 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1214 microversion: 2.1 time: 0.149293 Aug 31 09:49:27.320124 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 97/209] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:27 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1214 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:27.983373 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-cb6b6e31-2983-444b-bc38-c592d82f14d6 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:27.984124 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-cb6b6e31-2983-444b-bc38-c592d82f14d6 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:27.986980 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:28.001990 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb6b6e31-2983-444b-bc38-c592d82f14d6 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:28.004176 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb6b6e31-2983-444b-bc38-c592d82f14d6 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:28.004852 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb6b6e31-2983-444b-bc38-c592d82f14d6 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:28.006899 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb6b6e31-2983-444b-bc38-c592d82f14d6 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:28.006899 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb6b6e31-2983-444b-bc38-c592d82f14d6 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:28.006899 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb6b6e31-2983-444b-bc38-c592d82f14d6 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:28.336652 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-24497c59-c5a7-4770-bedf-b6191ca206ec tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:28.337581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-24497c59-c5a7-4770-bedf-b6191ca206ec tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:28.346605 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-24497c59-c5a7-4770-bedf-b6191ca206ec tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:28.348411 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-24497c59-c5a7-4770-bedf-b6191ca206ec tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:28.351611 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-24497c59-c5a7-4770-bedf-b6191ca206ec tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:28.355896 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-24497c59-c5a7-4770-bedf-b6191ca206ec tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:28.358619 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-24497c59-c5a7-4770-bedf-b6191ca206ec tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:28.362192 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-24497c59-c5a7-4770-bedf-b6191ca206ec tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:28.476504 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-cb6b6e31-2983-444b-bc38-c592d82f14d6 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:28.485287 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-cb6b6e31-2983-444b-bc38-c592d82f14d6 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.506436 Aug 31 09:49:28.501534 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 113/210] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:27 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:28.584521 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-24497c59-c5a7-4770-bedf-b6191ca206ec tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:28.642691 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-24497c59-c5a7-4770-bedf-b6191ca206ec tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1266 microversion: 2.1 time: 0.269833 Aug 31 09:49:28.658447 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 98/211] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:28 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1266 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:29.529975 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b2e03e4e-c9af-428b-9fb6-d0f7d908f0e5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:29.541980 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b2e03e4e-c9af-428b-9fb6-d0f7d908f0e5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:29.565652 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b2e03e4e-c9af-428b-9fb6-d0f7d908f0e5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:29.573922 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b2e03e4e-c9af-428b-9fb6-d0f7d908f0e5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:29.574443 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b2e03e4e-c9af-428b-9fb6-d0f7d908f0e5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:29.576432 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b2e03e4e-c9af-428b-9fb6-d0f7d908f0e5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:29.576432 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b2e03e4e-c9af-428b-9fb6-d0f7d908f0e5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:29.576921 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b2e03e4e-c9af-428b-9fb6-d0f7d908f0e5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:29.677413 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-895434da-4bf8-4fb3-bff9-9f644b46f35d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:29.677413 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-895434da-4bf8-4fb3-bff9-9f644b46f35d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:29.700052 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-895434da-4bf8-4fb3-bff9-9f644b46f35d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:29.700963 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-895434da-4bf8-4fb3-bff9-9f644b46f35d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:29.701790 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-895434da-4bf8-4fb3-bff9-9f644b46f35d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:29.703105 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-895434da-4bf8-4fb3-bff9-9f644b46f35d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:29.703979 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-895434da-4bf8-4fb3-bff9-9f644b46f35d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:29.715326 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-895434da-4bf8-4fb3-bff9-9f644b46f35d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:29.863971 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-895434da-4bf8-4fb3-bff9-9f644b46f35d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:29.884802 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-895434da-4bf8-4fb3-bff9-9f644b46f35d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1274 microversion: 2.1 time: 0.216621 Aug 31 09:49:29.899871 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 99/212] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:29 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1274 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:30.037804 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b2e03e4e-c9af-428b-9fb6-d0f7d908f0e5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:30.048762 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b2e03e4e-c9af-428b-9fb6-d0f7d908f0e5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.525967 Aug 31 09:49:30.050021 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 114/213] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:29 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:30.906872 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-6579b7ae-0538-47fd-83ca-e206237ea258 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:30.908290 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-6579b7ae-0538-47fd-83ca-e206237ea258 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:30.915709 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6579b7ae-0538-47fd-83ca-e206237ea258 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:30.916926 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6579b7ae-0538-47fd-83ca-e206237ea258 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:30.917638 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6579b7ae-0538-47fd-83ca-e206237ea258 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:30.918628 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6579b7ae-0538-47fd-83ca-e206237ea258 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:30.919332 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6579b7ae-0538-47fd-83ca-e206237ea258 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:30.919986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6579b7ae-0538-47fd-83ca-e206237ea258 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:31.016455 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-6579b7ae-0538-47fd-83ca-e206237ea258 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:31.026455 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-6579b7ae-0538-47fd-83ca-e206237ea258 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1274 microversion: 2.1 time: 0.123589 Aug 31 09:49:31.027860 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 100/214] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:30 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1274 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:31.078198 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-1b018fac-6064-4cfe-8ff5-5219267dea14 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:31.079387 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-1b018fac-6064-4cfe-8ff5-5219267dea14 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:31.091048 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1b018fac-6064-4cfe-8ff5-5219267dea14 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:31.092061 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1b018fac-6064-4cfe-8ff5-5219267dea14 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:31.092919 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1b018fac-6064-4cfe-8ff5-5219267dea14 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:31.094357 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1b018fac-6064-4cfe-8ff5-5219267dea14 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:31.096074 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1b018fac-6064-4cfe-8ff5-5219267dea14 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:31.096949 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1b018fac-6064-4cfe-8ff5-5219267dea14 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:31.381408 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-1b018fac-6064-4cfe-8ff5-5219267dea14 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:31.401207 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-1b018fac-6064-4cfe-8ff5-5219267dea14 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.331086 Aug 31 09:49:31.406064 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 115/215] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:31 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:32.066397 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9c2b657f-b257-4dd4-bac9-c5747ce2e962 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:32.068738 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-9c2b657f-b257-4dd4-bac9-c5747ce2e962 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:32.083316 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9c2b657f-b257-4dd4-bac9-c5747ce2e962 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:32.085567 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9c2b657f-b257-4dd4-bac9-c5747ce2e962 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:32.086678 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9c2b657f-b257-4dd4-bac9-c5747ce2e962 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:32.088375 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9c2b657f-b257-4dd4-bac9-c5747ce2e962 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:32.090068 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9c2b657f-b257-4dd4-bac9-c5747ce2e962 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:32.090963 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9c2b657f-b257-4dd4-bac9-c5747ce2e962 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:32.097362 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:32.226577 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-9c2b657f-b257-4dd4-bac9-c5747ce2e962 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:32.247070 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-9c2b657f-b257-4dd4-bac9-c5747ce2e962 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1274 microversion: 2.1 time: 0.187296 Aug 31 09:49:32.249028 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 101/216] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:32 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1274 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:32.457316 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-db2158a2-b4a0-4da8-8108-ce96d70155f8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:32.474069 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-db2158a2-b4a0-4da8-8108-ce96d70155f8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:32.492054 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-db2158a2-b4a0-4da8-8108-ce96d70155f8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:32.492767 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-db2158a2-b4a0-4da8-8108-ce96d70155f8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:32.493677 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-db2158a2-b4a0-4da8-8108-ce96d70155f8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:32.495261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-db2158a2-b4a0-4da8-8108-ce96d70155f8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:32.496064 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-db2158a2-b4a0-4da8-8108-ce96d70155f8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:32.496910 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-db2158a2-b4a0-4da8-8108-ce96d70155f8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:32.756431 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-db2158a2-b4a0-4da8-8108-ce96d70155f8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:32.857804 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-db2158a2-b4a0-4da8-8108-ce96d70155f8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.416621 Aug 31 09:49:32.859493 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 116/217] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:32 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:33.209214 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-ac079fbe-434f-4dac-ae4a-15d9b839c83a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Action: 'create', calling method: .version_select at 0x7f5503f7ae50>, body: {"keypair": {"name": "tempest-keypair-1792117911", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmaQvWUwyAtMxv0ek/1yNSfA7MQQJOySw2gmTi4fnepTL7Eg9TdvSCyO/hhXLJmFY+vXrYo+LKzqySJAsF1K+L+DzGHHKb4DQTQK2KjNzFXqc9zfauzxgHvgq8RUhl+OQ=="}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:33.231103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-ac079fbe-434f-4dac-ae4a-15d9b839c83a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Getting quotas for project 5ed9143757584694a5139ada8dbd5570. Resources: {'key_pairs'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:49:33.236529 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-ac079fbe-434f-4dac-ae4a-15d9b839c83a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Getting quotas for user 25b4233e5f0e41bf99b3fb3f5f6229c9 and project 5ed9143757584694a5139ada8dbd5570. Resources: {'key_pairs'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:49:33.266542 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-ac079fbe-434f-4dac-ae4a-15d9b839c83a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.213356 Aug 31 09:49:33.267614 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 102/218] 10.222.0.13 () {60 vars in 1159 bytes} [Wed Aug 31 09:49:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:33.275290 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-7af494c1-0f22-411a-b9b2-3207b2b3a241 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:33.276010 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-7af494c1-0f22-411a-b9b2-3207b2b3a241 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:33.284765 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7af494c1-0f22-411a-b9b2-3207b2b3a241 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:33.285536 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7af494c1-0f22-411a-b9b2-3207b2b3a241 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:33.286199 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7af494c1-0f22-411a-b9b2-3207b2b3a241 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:33.287602 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7af494c1-0f22-411a-b9b2-3207b2b3a241 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:33.287854 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7af494c1-0f22-411a-b9b2-3207b2b3a241 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:33.288455 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7af494c1-0f22-411a-b9b2-3207b2b3a241 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:33.415871 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-7af494c1-0f22-411a-b9b2-3207b2b3a241 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:33.425862 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-7af494c1-0f22-411a-b9b2-3207b2b3a241 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1284 microversion: 2.1 time: 0.156783 Aug 31 09:49:33.426445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 117/219] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:33 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:33.900816 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-2c971924-08cb-43bd-ba16-a056206254c9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:33.904763 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-2c971924-08cb-43bd-ba16-a056206254c9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:33.926131 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2c971924-08cb-43bd-ba16-a056206254c9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:33.927174 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2c971924-08cb-43bd-ba16-a056206254c9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:33.927927 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2c971924-08cb-43bd-ba16-a056206254c9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:33.929339 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2c971924-08cb-43bd-ba16-a056206254c9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:33.930201 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2c971924-08cb-43bd-ba16-a056206254c9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:33.930981 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2c971924-08cb-43bd-ba16-a056206254c9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:34.297198 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2c971924-08cb-43bd-ba16-a056206254c9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:34.306118 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-2c971924-08cb-43bd-ba16-a056206254c9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.416725 Aug 31 09:49:34.306696 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 103/220] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:33 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:34.466380 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b548907d-0a59-4fdc-8156-4bc4eff9ca2d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:34.468715 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b548907d-0a59-4fdc-8156-4bc4eff9ca2d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:34.495871 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b548907d-0a59-4fdc-8156-4bc4eff9ca2d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:34.499890 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b548907d-0a59-4fdc-8156-4bc4eff9ca2d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:34.503289 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b548907d-0a59-4fdc-8156-4bc4eff9ca2d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:34.506317 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b548907d-0a59-4fdc-8156-4bc4eff9ca2d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:34.507733 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b548907d-0a59-4fdc-8156-4bc4eff9ca2d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:34.508905 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b548907d-0a59-4fdc-8156-4bc4eff9ca2d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:34.648179 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b548907d-0a59-4fdc-8156-4bc4eff9ca2d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:34.674538 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b548907d-0a59-4fdc-8156-4bc4eff9ca2d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1272 microversion: 2.1 time: 0.211929 Aug 31 09:49:34.674538 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 118/221] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:34 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1272 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:35.333830 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-59f0c528-6b55-4003-908b-6b485fd344c5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:35.335165 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-59f0c528-6b55-4003-908b-6b485fd344c5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:35.351834 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-59f0c528-6b55-4003-908b-6b485fd344c5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:35.352420 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-59f0c528-6b55-4003-908b-6b485fd344c5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:35.352870 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-59f0c528-6b55-4003-908b-6b485fd344c5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:35.356946 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-59f0c528-6b55-4003-908b-6b485fd344c5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:35.357456 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-59f0c528-6b55-4003-908b-6b485fd344c5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:35.357893 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-59f0c528-6b55-4003-908b-6b485fd344c5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:35.718157 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-8648e9d7-50ff-4f67-8ab8-8744ec59e909 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:35.719737 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-8648e9d7-50ff-4f67-8ab8-8744ec59e909 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:35.739675 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8648e9d7-50ff-4f67-8ab8-8744ec59e909 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:35.742207 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8648e9d7-50ff-4f67-8ab8-8744ec59e909 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:35.743452 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8648e9d7-50ff-4f67-8ab8-8744ec59e909 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:35.745515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8648e9d7-50ff-4f67-8ab8-8744ec59e909 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:35.746843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8648e9d7-50ff-4f67-8ab8-8744ec59e909 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:35.748118 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8648e9d7-50ff-4f67-8ab8-8744ec59e909 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:35.921614 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-59f0c528-6b55-4003-908b-6b485fd344c5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:35.933494 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-59f0c528-6b55-4003-908b-6b485fd344c5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.606409 Aug 31 09:49:35.934090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 104/222] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:35 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:36.141063 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-8648e9d7-50ff-4f67-8ab8-8744ec59e909 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:36.189681 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-8648e9d7-50ff-4f67-8ab8-8744ec59e909 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1314 microversion: 2.1 time: 0.491874 Aug 31 09:49:36.192377 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 119/223] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:35 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:36.537252 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-83f97606-6c9c-4d6d-81bc-f356c5c7f92b req-def95feb-6511-409d-ae54-0903a86a4e94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74d01e00-bf25-4a74-b61e-b1503ad18c47", "tag": "cce2dbff-e77e-4c34-a575-46099f83471f"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:36.615433 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-83f97606-6c9c-4d6d-81bc-f356c5c7f92b req-def95feb-6511-409d-ae54-0903a86a4e94 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:36.618681 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-83f97606-6c9c-4d6d-81bc-f356c5c7f92b req-def95feb-6511-409d-ae54-0903a86a4e94 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:36.620448 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-83f97606-6c9c-4d6d-81bc-f356c5c7f92b req-def95feb-6511-409d-ae54-0903a86a4e94 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:36.669510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-4adc2b53-bf4d-4dd9-8b5d-4272524edfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1816476962", "imageRef": "8e078bb9-f274-4984-8128-d31407d49604", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ba3d70db-89a3-4a36-91f7-576971d6cd3f"}], "security_groups": [{"name": "tempest-securitygroup--1638476098"}], "key_name": "tempest-keypair-1792117911", "user_data": "}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:36.670365 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-83f97606-6c9c-4d6d-81bc-f356c5c7f92b req-def95feb-6511-409d-ae54-0903a86a4e94 service nova] Creating event network-changed:cce2dbff-e77e-4c34-a575-46099f83471f for instance 74d01e00-bf25-4a74-b61e-b1503ad18c47 on hv-cinder-84496 Aug 31 09:49:36.690630 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-83f97606-6c9c-4d6d-81bc-f356c5c7f92b req-def95feb-6511-409d-ae54-0903a86a4e94 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163757 Aug 31 09:49:36.699399 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 105/224] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:36.928808 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.network.neutron [None req-4adc2b53-bf4d-4dd9-8b5d-4272524edfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] validate_networks() for [('ba3d70db-89a3-4a36-91f7-576971d6cd3f', None, None, None, None, None)] {{(pid=127170) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:49:36.973509 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=2 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:36.984476 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-94465583-c2f0-4c1f-9b5d-469ee75c62d4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:36.985421 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-94465583-c2f0-4c1f-9b5d-469ee75c62d4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:36.992913 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-94465583-c2f0-4c1f-9b5d-469ee75c62d4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:36.993814 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-94465583-c2f0-4c1f-9b5d-469ee75c62d4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:36.994303 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-94465583-c2f0-4c1f-9b5d-469ee75c62d4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:36.995174 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-94465583-c2f0-4c1f-9b5d-469ee75c62d4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:36.995631 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-94465583-c2f0-4c1f-9b5d-469ee75c62d4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:36.996045 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-94465583-c2f0-4c1f-9b5d-469ee75c62d4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:37.012701 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=6 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:37.347735 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-94465583-c2f0-4c1f-9b5d-469ee75c62d4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:37.366213 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-94465583-c2f0-4c1f-9b5d-469ee75c62d4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.388572 Aug 31 09:49:37.379288 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 106/225] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:36 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:37.391283 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-da9e1282-ec85-468c-bae0-fb97625febea tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:37.392839 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-da9e1282-ec85-468c-bae0-fb97625febea tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:37.403501 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-da9e1282-ec85-468c-bae0-fb97625febea tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:37.404192 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-da9e1282-ec85-468c-bae0-fb97625febea tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:37.404704 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-da9e1282-ec85-468c-bae0-fb97625febea tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:37.405498 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-da9e1282-ec85-468c-bae0-fb97625febea tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:37.406412 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-da9e1282-ec85-468c-bae0-fb97625febea tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:37.409015 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-da9e1282-ec85-468c-bae0-fb97625febea tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:37.843110 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-da9e1282-ec85-468c-bae0-fb97625febea tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:37.877448 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-da9e1282-ec85-468c-bae0-fb97625febea tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1314 microversion: 2.1 time: 0.495830 Aug 31 09:49:37.878154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 107/226] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:37 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:38.025623 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-4adc2b53-bf4d-4dd9-8b5d-4272524edfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Flavor limits 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:49:38.028303 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-4adc2b53-bf4d-4dd9-8b5d-4272524edfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Image limits 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:49:38.028755 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-4adc2b53-bf4d-4dd9-8b5d-4272524edfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Flavor pref 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:49:38.029163 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-4adc2b53-bf4d-4dd9-8b5d-4272524edfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Image pref 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:49:38.029612 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-4adc2b53-bf4d-4dd9-8b5d-4272524edfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:49:38.039736 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4adc2b53-bf4d-4dd9-8b5d-4272524edfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:38.040221 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4adc2b53-bf4d-4dd9-8b5d-4272524edfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:38.040660 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4adc2b53-bf4d-4dd9-8b5d-4272524edfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:38.041649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4adc2b53-bf4d-4dd9-8b5d-4272524edfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:38.042104 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4adc2b53-bf4d-4dd9-8b5d-4272524edfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:38.042521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4adc2b53-bf4d-4dd9-8b5d-4272524edfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:38.062957 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-4adc2b53-bf4d-4dd9-8b5d-4272524edfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Getting quotas for project 5ed9143757584694a5139ada8dbd5570. Resources: {'ram', 'instances', 'cores'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:49:38.070486 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-4adc2b53-bf4d-4dd9-8b5d-4272524edfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Getting quotas for user 25b4233e5f0e41bf99b3fb3f5f6229c9 and project 5ed9143757584694a5139ada8dbd5570. Resources: {'ram', 'instances', 'cores'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:49:38.084272 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-4adc2b53-bf4d-4dd9-8b5d-4272524edfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Going to run 1 instances... {{(pid=127170) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:49:38.086774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-4adc2b53-bf4d-4dd9-8b5d-4272524edfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8e078bb9-f274-4984-8128-d31407d49604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:49:38.156639 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-4adc2b53-bf4d-4dd9-8b5d-4272524edfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.494297 Aug 31 09:49:38.158950 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 120/227] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 31 09:49:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 1497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 09:49:38.170665 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-3d8f97e3-08b8-465c-b608-a397e3878d95 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:38.171811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-3d8f97e3-08b8-465c-b608-a397e3878d95 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:38.247310 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-3d8f97e3-08b8-465c-b608-a397e3878d95 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:38.259506 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-3d8f97e3-08b8-465c-b608-a397e3878d95 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1242 microversion: 2.1 time: 0.093388 Aug 31 09:49:38.260313 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 108/228] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:38 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:38.409357 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-6a3fe639-319a-4b48-b7e3-0a0dc5215090 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:38.411426 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-6a3fe639-319a-4b48-b7e3-0a0dc5215090 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:38.428033 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6a3fe639-319a-4b48-b7e3-0a0dc5215090 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:38.429121 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6a3fe639-319a-4b48-b7e3-0a0dc5215090 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:38.430007 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6a3fe639-319a-4b48-b7e3-0a0dc5215090 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:38.431452 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6a3fe639-319a-4b48-b7e3-0a0dc5215090 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:38.432345 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6a3fe639-319a-4b48-b7e3-0a0dc5215090 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:38.433434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6a3fe639-319a-4b48-b7e3-0a0dc5215090 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:38.700217 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-6a3fe639-319a-4b48-b7e3-0a0dc5215090 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:38.710966 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-6a3fe639-319a-4b48-b7e3-0a0dc5215090 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.311259 Aug 31 09:49:38.714585 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 121/229] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:38 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:38.916793 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-b19c39cc-5c44-4d51-b30d-b3ed06496378 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:38.918542 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-b19c39cc-5c44-4d51-b30d-b3ed06496378 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:38.941271 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b19c39cc-5c44-4d51-b30d-b3ed06496378 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:38.942490 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b19c39cc-5c44-4d51-b30d-b3ed06496378 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:38.943450 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b19c39cc-5c44-4d51-b30d-b3ed06496378 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:38.945485 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b19c39cc-5c44-4d51-b30d-b3ed06496378 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:38.946526 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b19c39cc-5c44-4d51-b30d-b3ed06496378 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:38.947660 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b19c39cc-5c44-4d51-b30d-b3ed06496378 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:39.283416 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-0c97ca74-a434-45c0-9b99-ffca627c7640 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:39.285161 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-0c97ca74-a434-45c0-9b99-ffca627c7640 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:39.294789 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0c97ca74-a434-45c0-9b99-ffca627c7640 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:39.295754 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0c97ca74-a434-45c0-9b99-ffca627c7640 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:39.296469 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0c97ca74-a434-45c0-9b99-ffca627c7640 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:39.297490 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0c97ca74-a434-45c0-9b99-ffca627c7640 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:39.298906 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0c97ca74-a434-45c0-9b99-ffca627c7640 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:39.299628 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0c97ca74-a434-45c0-9b99-ffca627c7640 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:39.303316 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=100 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:39.499698 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-0c97ca74-a434-45c0-9b99-ffca627c7640 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:39.509122 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-0c97ca74-a434-45c0-9b99-ffca627c7640 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1246 microversion: 2.1 time: 0.230074 Aug 31 09:49:39.509800 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 122/230] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:39 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1246 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:39.536395 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b19c39cc-5c44-4d51-b30d-b3ed06496378 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:39.550037 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-b19c39cc-5c44-4d51-b30d-b3ed06496378 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1314 microversion: 2.1 time: 0.648591 Aug 31 09:49:39.551152 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 109/231] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:38 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:39.736883 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-958a33f0-e04b-4e17-ae8e-aed3bda3d12a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:39.737677 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-958a33f0-e04b-4e17-ae8e-aed3bda3d12a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:39.745514 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-958a33f0-e04b-4e17-ae8e-aed3bda3d12a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:39.746155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-958a33f0-e04b-4e17-ae8e-aed3bda3d12a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:39.746688 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-958a33f0-e04b-4e17-ae8e-aed3bda3d12a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:39.747481 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-958a33f0-e04b-4e17-ae8e-aed3bda3d12a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:39.748193 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-958a33f0-e04b-4e17-ae8e-aed3bda3d12a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:39.748732 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-958a33f0-e04b-4e17-ae8e-aed3bda3d12a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:39.902605 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-958a33f0-e04b-4e17-ae8e-aed3bda3d12a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:39.917408 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-958a33f0-e04b-4e17-ae8e-aed3bda3d12a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.184702 Aug 31 09:49:39.918835 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 123/232] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:39 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:40.535507 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-f5de6274-c159-405e-8085-ee204728381f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:40.536551 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-f5de6274-c159-405e-8085-ee204728381f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:40.553963 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f5de6274-c159-405e-8085-ee204728381f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:40.556121 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f5de6274-c159-405e-8085-ee204728381f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:40.557548 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f5de6274-c159-405e-8085-ee204728381f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:40.560242 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f5de6274-c159-405e-8085-ee204728381f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:40.561464 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f5de6274-c159-405e-8085-ee204728381f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:40.563119 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f5de6274-c159-405e-8085-ee204728381f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:40.589094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-250b4208-9307-40b1-9c6b-90b126808874 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:40.593888 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-250b4208-9307-40b1-9c6b-90b126808874 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:40.612785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-250b4208-9307-40b1-9c6b-90b126808874 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:40.613695 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-250b4208-9307-40b1-9c6b-90b126808874 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:40.614492 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-250b4208-9307-40b1-9c6b-90b126808874 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:40.617674 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-250b4208-9307-40b1-9c6b-90b126808874 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:40.618975 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-250b4208-9307-40b1-9c6b-90b126808874 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:40.619866 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-250b4208-9307-40b1-9c6b-90b126808874 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:40.696966 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-f5de6274-c159-405e-8085-ee204728381f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:40.711560 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-f5de6274-c159-405e-8085-ee204728381f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1246 microversion: 2.1 time: 0.183360 Aug 31 09:49:40.712951 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 110/233] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:40 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1246 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:40.920691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-250b4208-9307-40b1-9c6b-90b126808874 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:40.933712 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-250b4208-9307-40b1-9c6b-90b126808874 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1314 microversion: 2.1 time: 0.351783 Aug 31 09:49:40.934489 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 124/234] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:40 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:40.956334 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-eae94a04-9961-4eec-b3e8-884f3dcc2f68 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:40.957074 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-eae94a04-9961-4eec-b3e8-884f3dcc2f68 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:40.965090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-eae94a04-9961-4eec-b3e8-884f3dcc2f68 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:40.965704 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-eae94a04-9961-4eec-b3e8-884f3dcc2f68 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:40.966339 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-eae94a04-9961-4eec-b3e8-884f3dcc2f68 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:40.966945 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-eae94a04-9961-4eec-b3e8-884f3dcc2f68 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:40.967491 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-eae94a04-9961-4eec-b3e8-884f3dcc2f68 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:40.967957 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-eae94a04-9961-4eec-b3e8-884f3dcc2f68 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:41.403583 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-eae94a04-9961-4eec-b3e8-884f3dcc2f68 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:41.424150 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-eae94a04-9961-4eec-b3e8-884f3dcc2f68 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.471701 Aug 31 09:49:41.426297 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 111/235] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:40 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:41.734974 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-87b5d6b8-bf77-4f18-9aa3-2ef69f8d7079 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:41.736321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-87b5d6b8-bf77-4f18-9aa3-2ef69f8d7079 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:41.743282 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-87b5d6b8-bf77-4f18-9aa3-2ef69f8d7079 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:41.743847 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-87b5d6b8-bf77-4f18-9aa3-2ef69f8d7079 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:41.744315 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-87b5d6b8-bf77-4f18-9aa3-2ef69f8d7079 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:41.745060 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-87b5d6b8-bf77-4f18-9aa3-2ef69f8d7079 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:41.745609 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-87b5d6b8-bf77-4f18-9aa3-2ef69f8d7079 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:41.746067 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-87b5d6b8-bf77-4f18-9aa3-2ef69f8d7079 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:41.816714 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-87b5d6b8-bf77-4f18-9aa3-2ef69f8d7079 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:41.826030 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-87b5d6b8-bf77-4f18-9aa3-2ef69f8d7079 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1294 microversion: 2.1 time: 0.094832 Aug 31 09:49:41.826630 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 125/236] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:41 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1294 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:41.972500 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-5dcfd8d0-6942-4413-b2ef-495165848a4e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:41.973651 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-5dcfd8d0-6942-4413-b2ef-495165848a4e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:41.985626 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5dcfd8d0-6942-4413-b2ef-495165848a4e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:41.986498 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5dcfd8d0-6942-4413-b2ef-495165848a4e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:41.987224 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5dcfd8d0-6942-4413-b2ef-495165848a4e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:41.988263 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5dcfd8d0-6942-4413-b2ef-495165848a4e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:41.989167 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5dcfd8d0-6942-4413-b2ef-495165848a4e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:41.989821 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5dcfd8d0-6942-4413-b2ef-495165848a4e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:42.178691 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-5dcfd8d0-6942-4413-b2ef-495165848a4e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:42.187138 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-5dcfd8d0-6942-4413-b2ef-495165848a4e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1314 microversion: 2.1 time: 0.222188 Aug 31 09:49:42.187798 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 112/237] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:41 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:42.467238 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-d82c5d46-eca6-414f-b5ea-44a3c572e07f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:42.468410 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-d82c5d46-eca6-414f-b5ea-44a3c572e07f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:42.480075 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d82c5d46-eca6-414f-b5ea-44a3c572e07f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:42.481006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d82c5d46-eca6-414f-b5ea-44a3c572e07f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:42.481838 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d82c5d46-eca6-414f-b5ea-44a3c572e07f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:42.483230 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d82c5d46-eca6-414f-b5ea-44a3c572e07f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:42.484072 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d82c5d46-eca6-414f-b5ea-44a3c572e07f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:42.484840 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d82c5d46-eca6-414f-b5ea-44a3c572e07f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:42.686443 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-d82c5d46-eca6-414f-b5ea-44a3c572e07f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:42.696813 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-d82c5d46-eca6-414f-b5ea-44a3c572e07f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.239329 Aug 31 09:49:42.697676 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 126/238] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:42 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:42.849781 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-6ea3b61b-f092-44ad-b71c-98e22cf240e6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:42.850645 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-6ea3b61b-f092-44ad-b71c-98e22cf240e6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:42.857544 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6ea3b61b-f092-44ad-b71c-98e22cf240e6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:42.858034 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6ea3b61b-f092-44ad-b71c-98e22cf240e6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:42.858475 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6ea3b61b-f092-44ad-b71c-98e22cf240e6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:42.859191 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6ea3b61b-f092-44ad-b71c-98e22cf240e6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:42.859643 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6ea3b61b-f092-44ad-b71c-98e22cf240e6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:42.860061 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6ea3b61b-f092-44ad-b71c-98e22cf240e6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:42.930466 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-6ea3b61b-f092-44ad-b71c-98e22cf240e6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:42.939749 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-6ea3b61b-f092-44ad-b71c-98e22cf240e6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1294 microversion: 2.1 time: 0.094978 Aug 31 09:49:42.940338 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 113/239] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:42 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1294 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:43.213149 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b699eed5-56bd-427e-b413-b205a78da389 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:43.214264 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b699eed5-56bd-427e-b413-b205a78da389 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:43.227321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b699eed5-56bd-427e-b413-b205a78da389 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:43.228615 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b699eed5-56bd-427e-b413-b205a78da389 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:43.229411 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b699eed5-56bd-427e-b413-b205a78da389 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:43.230655 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b699eed5-56bd-427e-b413-b205a78da389 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:43.231472 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b699eed5-56bd-427e-b413-b205a78da389 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:43.232240 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b699eed5-56bd-427e-b413-b205a78da389 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:43.588590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b699eed5-56bd-427e-b413-b205a78da389 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:43.599185 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b699eed5-56bd-427e-b413-b205a78da389 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1314 microversion: 2.1 time: 0.393018 Aug 31 09:49:43.603329 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 127/240] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:43 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:43.722682 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c9f22096-1924-478c-88a2-d94908896812 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:43.730604 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c9f22096-1924-478c-88a2-d94908896812 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:43.740572 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c9f22096-1924-478c-88a2-d94908896812 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:43.745803 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c9f22096-1924-478c-88a2-d94908896812 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:43.746255 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c9f22096-1924-478c-88a2-d94908896812 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:43.746999 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c9f22096-1924-478c-88a2-d94908896812 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:43.751425 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c9f22096-1924-478c-88a2-d94908896812 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:43.752245 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c9f22096-1924-478c-88a2-d94908896812 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:43.965591 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-10e86df9-a5a7-4ccc-bbfb-70f7b91e0c9d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:43.966753 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-10e86df9-a5a7-4ccc-bbfb-70f7b91e0c9d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:43.984495 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-10e86df9-a5a7-4ccc-bbfb-70f7b91e0c9d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:43.985217 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-10e86df9-a5a7-4ccc-bbfb-70f7b91e0c9d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:43.989419 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-10e86df9-a5a7-4ccc-bbfb-70f7b91e0c9d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:43.990985 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-10e86df9-a5a7-4ccc-bbfb-70f7b91e0c9d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:43.990985 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-10e86df9-a5a7-4ccc-bbfb-70f7b91e0c9d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:43.991330 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-10e86df9-a5a7-4ccc-bbfb-70f7b91e0c9d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:44.006838 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c9f22096-1924-478c-88a2-d94908896812 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:44.024672 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c9f22096-1924-478c-88a2-d94908896812 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.308535 Aug 31 09:49:44.026073 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 114/241] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:43 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:44.099051 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-10e86df9-a5a7-4ccc-bbfb-70f7b91e0c9d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:44.111836 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-10e86df9-a5a7-4ccc-bbfb-70f7b91e0c9d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1300 microversion: 2.1 time: 0.153131 Aug 31 09:49:44.112904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 128/242] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:43 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1300 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:44.645995 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-42e5df1c-afbe-422e-9222-a92ade3b530b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:44.646615 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-42e5df1c-afbe-422e-9222-a92ade3b530b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:44.653035 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-42e5df1c-afbe-422e-9222-a92ade3b530b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:44.653569 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-42e5df1c-afbe-422e-9222-a92ade3b530b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:44.654008 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-42e5df1c-afbe-422e-9222-a92ade3b530b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:44.654721 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-42e5df1c-afbe-422e-9222-a92ade3b530b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:44.655175 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-42e5df1c-afbe-422e-9222-a92ade3b530b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:44.655595 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-42e5df1c-afbe-422e-9222-a92ade3b530b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:44.799130 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-42e5df1c-afbe-422e-9222-a92ade3b530b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:44.807483 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-42e5df1c-afbe-422e-9222-a92ade3b530b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1314 microversion: 2.1 time: 0.165929 Aug 31 09:49:44.808089 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 115/243] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:44 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:45.061881 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-d67b89de-988e-4fb0-983b-3818668e5089 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:45.063817 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-d67b89de-988e-4fb0-983b-3818668e5089 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:45.071532 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d67b89de-988e-4fb0-983b-3818668e5089 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:45.072127 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d67b89de-988e-4fb0-983b-3818668e5089 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:45.072634 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d67b89de-988e-4fb0-983b-3818668e5089 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:45.073480 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d67b89de-988e-4fb0-983b-3818668e5089 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:45.074200 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d67b89de-988e-4fb0-983b-3818668e5089 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:45.074688 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d67b89de-988e-4fb0-983b-3818668e5089 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:45.139133 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-4eac35e7-0d00-432b-8863-3dd0a273a73d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:45.139905 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-4eac35e7-0d00-432b-8863-3dd0a273a73d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:45.147678 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4eac35e7-0d00-432b-8863-3dd0a273a73d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:45.148189 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4eac35e7-0d00-432b-8863-3dd0a273a73d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:45.148630 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4eac35e7-0d00-432b-8863-3dd0a273a73d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:45.149672 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4eac35e7-0d00-432b-8863-3dd0a273a73d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:45.150135 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4eac35e7-0d00-432b-8863-3dd0a273a73d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:45.150552 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4eac35e7-0d00-432b-8863-3dd0a273a73d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:45.251403 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-4eac35e7-0d00-432b-8863-3dd0a273a73d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:45.266983 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-4eac35e7-0d00-432b-8863-3dd0a273a73d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1300 microversion: 2.1 time: 0.135056 Aug 31 09:49:45.268110 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 116/244] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:45 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1300 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:45.300536 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-d67b89de-988e-4fb0-983b-3818668e5089 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:45.313099 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-d67b89de-988e-4fb0-983b-3818668e5089 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.255283 Aug 31 09:49:45.313945 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 129/245] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:45 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:45.833794 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-ca17db69-47f4-47a6-b38c-bb49b567de73 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:45.834902 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-ca17db69-47f4-47a6-b38c-bb49b567de73 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:45.847070 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ca17db69-47f4-47a6-b38c-bb49b567de73 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:45.847613 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ca17db69-47f4-47a6-b38c-bb49b567de73 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:45.848152 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ca17db69-47f4-47a6-b38c-bb49b567de73 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:45.849006 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ca17db69-47f4-47a6-b38c-bb49b567de73 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:45.850664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ca17db69-47f4-47a6-b38c-bb49b567de73 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:45.851183 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ca17db69-47f4-47a6-b38c-bb49b567de73 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:46.050624 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-ca17db69-47f4-47a6-b38c-bb49b567de73 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:46.058916 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-ca17db69-47f4-47a6-b38c-bb49b567de73 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1314 microversion: 2.1 time: 0.232051 Aug 31 09:49:46.059518 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 117/246] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:45 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:46.300811 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-72b95496-55fc-471d-a102-32c740507857 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:46.301464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-72b95496-55fc-471d-a102-32c740507857 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:46.307810 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-72b95496-55fc-471d-a102-32c740507857 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:46.308361 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-72b95496-55fc-471d-a102-32c740507857 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:46.308829 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-72b95496-55fc-471d-a102-32c740507857 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:46.309563 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-72b95496-55fc-471d-a102-32c740507857 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:46.310054 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-72b95496-55fc-471d-a102-32c740507857 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:46.310557 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-72b95496-55fc-471d-a102-32c740507857 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:46.340665 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-953c44ef-bbbc-4fa8-bb34-c0abc03bc1da tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:46.341760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-953c44ef-bbbc-4fa8-bb34-c0abc03bc1da tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:46.349449 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-953c44ef-bbbc-4fa8-bb34-c0abc03bc1da tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:46.349958 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-953c44ef-bbbc-4fa8-bb34-c0abc03bc1da tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:46.350403 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-953c44ef-bbbc-4fa8-bb34-c0abc03bc1da tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:46.351126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-953c44ef-bbbc-4fa8-bb34-c0abc03bc1da tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:46.351581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-953c44ef-bbbc-4fa8-bb34-c0abc03bc1da tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:46.352015 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-953c44ef-bbbc-4fa8-bb34-c0abc03bc1da tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:46.525022 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-72b95496-55fc-471d-a102-32c740507857 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:46.538193 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-72b95496-55fc-471d-a102-32c740507857 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1368 microversion: 2.1 time: 0.243182 Aug 31 09:49:46.539591 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 130/247] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:46 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1368 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:46.558175 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-953c44ef-bbbc-4fa8-bb34-c0abc03bc1da tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:46.570129 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-953c44ef-bbbc-4fa8-bb34-c0abc03bc1da tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.233749 Aug 31 09:49:46.570730 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 118/248] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:46 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:47.093773 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-0579ad45-4df7-4e72-ad2d-944c467639a2 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:47.098460 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-0579ad45-4df7-4e72-ad2d-944c467639a2 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:47.106233 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0579ad45-4df7-4e72-ad2d-944c467639a2 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:47.106989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0579ad45-4df7-4e72-ad2d-944c467639a2 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:47.107472 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0579ad45-4df7-4e72-ad2d-944c467639a2 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:47.108257 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0579ad45-4df7-4e72-ad2d-944c467639a2 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:47.108766 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0579ad45-4df7-4e72-ad2d-944c467639a2 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:47.109232 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0579ad45-4df7-4e72-ad2d-944c467639a2 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:47.262881 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-0579ad45-4df7-4e72-ad2d-944c467639a2 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:47.273592 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-0579ad45-4df7-4e72-ad2d-944c467639a2 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1314 microversion: 2.1 time: 0.189727 Aug 31 09:49:47.274707 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 131/249] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:47 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:47.576591 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-2a65e131-a8da-41ee-9bd9-a1618d7b5d8a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:47.578020 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-2a65e131-a8da-41ee-9bd9-a1618d7b5d8a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:47.591692 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2a65e131-a8da-41ee-9bd9-a1618d7b5d8a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:47.592878 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2a65e131-a8da-41ee-9bd9-a1618d7b5d8a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:47.593793 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2a65e131-a8da-41ee-9bd9-a1618d7b5d8a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:47.597431 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2a65e131-a8da-41ee-9bd9-a1618d7b5d8a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:47.597431 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2a65e131-a8da-41ee-9bd9-a1618d7b5d8a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:47.597431 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2a65e131-a8da-41ee-9bd9-a1618d7b5d8a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:47.598324 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-4c8b09a7-f220-4bcc-a1f9-ce108264b84f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:47.600535 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-4c8b09a7-f220-4bcc-a1f9-ce108264b84f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:47.615637 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4c8b09a7-f220-4bcc-a1f9-ce108264b84f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:47.616496 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4c8b09a7-f220-4bcc-a1f9-ce108264b84f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:47.617214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4c8b09a7-f220-4bcc-a1f9-ce108264b84f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:47.618446 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4c8b09a7-f220-4bcc-a1f9-ce108264b84f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:47.619448 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4c8b09a7-f220-4bcc-a1f9-ce108264b84f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:47.620454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4c8b09a7-f220-4bcc-a1f9-ce108264b84f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:47.904726 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2a65e131-a8da-41ee-9bd9-a1618d7b5d8a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:47.910329 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-4c8b09a7-f220-4bcc-a1f9-ce108264b84f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:47.914003 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-2a65e131-a8da-41ee-9bd9-a1618d7b5d8a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1368 microversion: 2.1 time: 0.344286 Aug 31 09:49:47.914596 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 119/250] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:47 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1368 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:47.918738 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-4c8b09a7-f220-4bcc-a1f9-ce108264b84f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.328669 Aug 31 09:49:47.919427 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 132/251] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:47 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:48.295934 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-d4997116-3a5c-45ad-8c54-327dda13b84b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:48.296798 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-d4997116-3a5c-45ad-8c54-327dda13b84b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:48.299306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=8 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:48.306329 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d4997116-3a5c-45ad-8c54-327dda13b84b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:48.307278 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d4997116-3a5c-45ad-8c54-327dda13b84b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:48.307904 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d4997116-3a5c-45ad-8c54-327dda13b84b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:48.308790 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d4997116-3a5c-45ad-8c54-327dda13b84b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:48.309414 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d4997116-3a5c-45ad-8c54-327dda13b84b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:48.309978 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d4997116-3a5c-45ad-8c54-327dda13b84b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:48.329911 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=100 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:48.520008 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-d4997116-3a5c-45ad-8c54-327dda13b84b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:48.534696 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-d4997116-3a5c-45ad-8c54-327dda13b84b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1314 microversion: 2.1 time: 0.242387 Aug 31 09:49:48.535718 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 120/252] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:48 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:48.941161 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-1d377513-2e77-4fd1-a684-5633e5b3d520 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:48.941812 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-1d377513-2e77-4fd1-a684-5633e5b3d520 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:48.943751 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=2 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:48.944418 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=6 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:48.945823 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c4a569d3-ba52-446e-8fe5-e417e374498b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:48.946840 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c4a569d3-ba52-446e-8fe5-e417e374498b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:48.950566 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1d377513-2e77-4fd1-a684-5633e5b3d520 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:48.951170 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1d377513-2e77-4fd1-a684-5633e5b3d520 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:48.952128 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1d377513-2e77-4fd1-a684-5633e5b3d520 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:48.952474 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1d377513-2e77-4fd1-a684-5633e5b3d520 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:48.953043 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1d377513-2e77-4fd1-a684-5633e5b3d520 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:48.953588 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1d377513-2e77-4fd1-a684-5633e5b3d520 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:48.957453 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4a569d3-ba52-446e-8fe5-e417e374498b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:48.958224 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4a569d3-ba52-446e-8fe5-e417e374498b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:48.958898 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4a569d3-ba52-446e-8fe5-e417e374498b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:48.961435 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4a569d3-ba52-446e-8fe5-e417e374498b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:48.961435 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4a569d3-ba52-446e-8fe5-e417e374498b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:48.961782 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4a569d3-ba52-446e-8fe5-e417e374498b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:49.190359 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-1d377513-2e77-4fd1-a684-5633e5b3d520 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:49.200792 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-1d377513-2e77-4fd1-a684-5633e5b3d520 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1368 microversion: 2.1 time: 0.264088 Aug 31 09:49:49.201088 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c4a569d3-ba52-446e-8fe5-e417e374498b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:49.202591 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 133/253] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:48 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1368 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:49.211019 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c4a569d3-ba52-446e-8fe5-e417e374498b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.269876 Aug 31 09:49:49.211795 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 121/254] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:48 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:49.568481 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-fcbbb3b0-b2cf-43a0-a04d-d19be016f23d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:49.569226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-fcbbb3b0-b2cf-43a0-a04d-d19be016f23d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:49.578737 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fcbbb3b0-b2cf-43a0-a04d-d19be016f23d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:49.580040 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fcbbb3b0-b2cf-43a0-a04d-d19be016f23d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:49.580577 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fcbbb3b0-b2cf-43a0-a04d-d19be016f23d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:49.581322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fcbbb3b0-b2cf-43a0-a04d-d19be016f23d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:49.581869 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fcbbb3b0-b2cf-43a0-a04d-d19be016f23d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:49.582493 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fcbbb3b0-b2cf-43a0-a04d-d19be016f23d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:49.820803 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-fcbbb3b0-b2cf-43a0-a04d-d19be016f23d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:49.831007 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-fcbbb3b0-b2cf-43a0-a04d-d19be016f23d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1314 microversion: 2.1 time: 0.265992 Aug 31 09:49:49.831007 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 134/255] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:49 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:50.232166 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-5ea63922-a616-470e-a859-2ef95089bb5a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:50.233182 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-5ea63922-a616-470e-a859-2ef95089bb5a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:50.239333 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a657acf0-7eb2-4215-80fb-c0a72574a25d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:50.239927 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-a657acf0-7eb2-4215-80fb-c0a72574a25d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:50.246445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a657acf0-7eb2-4215-80fb-c0a72574a25d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:50.246927 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a657acf0-7eb2-4215-80fb-c0a72574a25d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:50.247189 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5ea63922-a616-470e-a859-2ef95089bb5a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:50.247364 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a657acf0-7eb2-4215-80fb-c0a72574a25d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:50.247940 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5ea63922-a616-470e-a859-2ef95089bb5a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:50.248346 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a657acf0-7eb2-4215-80fb-c0a72574a25d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:50.248764 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5ea63922-a616-470e-a859-2ef95089bb5a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:50.248883 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a657acf0-7eb2-4215-80fb-c0a72574a25d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:50.249199 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a657acf0-7eb2-4215-80fb-c0a72574a25d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:50.250342 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5ea63922-a616-470e-a859-2ef95089bb5a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:50.251155 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5ea63922-a616-470e-a859-2ef95089bb5a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:50.252089 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5ea63922-a616-470e-a859-2ef95089bb5a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:50.480299 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-a657acf0-7eb2-4215-80fb-c0a72574a25d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:50.486213 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-5ea63922-a616-470e-a859-2ef95089bb5a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:50.497933 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a657acf0-7eb2-4215-80fb-c0a72574a25d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.259661 Aug 31 09:49:50.497933 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 135/256] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:50 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:50.503111 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-5ea63922-a616-470e-a859-2ef95089bb5a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1368 microversion: 2.1 time: 0.275092 Aug 31 09:49:50.503832 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 122/257] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:50 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1368 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:50.853143 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b849cbf1-c722-4620-b9fc-99e083ee6487 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:50.853890 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b849cbf1-c722-4620-b9fc-99e083ee6487 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:50.860806 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b849cbf1-c722-4620-b9fc-99e083ee6487 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:50.861420 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b849cbf1-c722-4620-b9fc-99e083ee6487 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:50.861842 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b849cbf1-c722-4620-b9fc-99e083ee6487 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:50.862611 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b849cbf1-c722-4620-b9fc-99e083ee6487 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:50.863065 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b849cbf1-c722-4620-b9fc-99e083ee6487 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:50.863485 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b849cbf1-c722-4620-b9fc-99e083ee6487 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:51.026809 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b849cbf1-c722-4620-b9fc-99e083ee6487 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:51.035283 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b849cbf1-c722-4620-b9fc-99e083ee6487 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1314 microversion: 2.1 time: 0.186068 Aug 31 09:49:51.035868 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 136/258] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:50 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:51.517191 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-0b5f094a-5b16-4b1a-88a3-71e3dc32fe7e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:51.518120 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-0b5f094a-5b16-4b1a-88a3-71e3dc32fe7e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:51.525538 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0b5f094a-5b16-4b1a-88a3-71e3dc32fe7e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:51.526113 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0b5f094a-5b16-4b1a-88a3-71e3dc32fe7e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:51.526639 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0b5f094a-5b16-4b1a-88a3-71e3dc32fe7e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:51.527931 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-d4d4d498-d250-42a2-8a85-1a35381d5312 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:51.529061 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-d4d4d498-d250-42a2-8a85-1a35381d5312 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:51.529225 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0b5f094a-5b16-4b1a-88a3-71e3dc32fe7e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:51.529609 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0b5f094a-5b16-4b1a-88a3-71e3dc32fe7e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:51.530048 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0b5f094a-5b16-4b1a-88a3-71e3dc32fe7e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:51.540608 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d4d4d498-d250-42a2-8a85-1a35381d5312 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:51.541518 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d4d4d498-d250-42a2-8a85-1a35381d5312 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:51.542327 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d4d4d498-d250-42a2-8a85-1a35381d5312 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:51.543573 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d4d4d498-d250-42a2-8a85-1a35381d5312 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:51.544406 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d4d4d498-d250-42a2-8a85-1a35381d5312 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:51.545174 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d4d4d498-d250-42a2-8a85-1a35381d5312 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:51.735563 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-0b5f094a-5b16-4b1a-88a3-71e3dc32fe7e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:51.747664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-0b5f094a-5b16-4b1a-88a3-71e3dc32fe7e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.235062 Aug 31 09:49:51.748306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 123/259] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:51 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:51.772294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-d4d4d498-d250-42a2-8a85-1a35381d5312 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:51.781266 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-d4d4d498-d250-42a2-8a85-1a35381d5312 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1368 microversion: 2.1 time: 0.260102 Aug 31 09:49:51.782693 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 137/260] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:51 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1368 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:52.060055 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c5405c4b-eb65-4ed0-a5e8-df84ab875f7e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:52.060910 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c5405c4b-eb65-4ed0-a5e8-df84ab875f7e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:52.071323 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c5405c4b-eb65-4ed0-a5e8-df84ab875f7e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:52.072072 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c5405c4b-eb65-4ed0-a5e8-df84ab875f7e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:52.072736 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c5405c4b-eb65-4ed0-a5e8-df84ab875f7e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:52.073852 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c5405c4b-eb65-4ed0-a5e8-df84ab875f7e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:52.074542 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c5405c4b-eb65-4ed0-a5e8-df84ab875f7e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:52.075184 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c5405c4b-eb65-4ed0-a5e8-df84ab875f7e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:52.231283 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c5405c4b-eb65-4ed0-a5e8-df84ab875f7e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:52.239871 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c5405c4b-eb65-4ed0-a5e8-df84ab875f7e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1314 microversion: 2.1 time: 0.186413 Aug 31 09:49:52.240469 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 124/261] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:52 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:52.785663 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-2ec2897c-7c11-4273-8366-f25c48875538 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:52.786547 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-2ec2897c-7c11-4273-8366-f25c48875538 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:52.795385 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2ec2897c-7c11-4273-8366-f25c48875538 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:52.795938 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2ec2897c-7c11-4273-8366-f25c48875538 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:52.796422 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2ec2897c-7c11-4273-8366-f25c48875538 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:52.797628 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2ec2897c-7c11-4273-8366-f25c48875538 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:52.798304 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2ec2897c-7c11-4273-8366-f25c48875538 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:52.798735 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2ec2897c-7c11-4273-8366-f25c48875538 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:52.808486 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-8b9e8372-9f50-4471-9d67-44f486506536 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:52.809464 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-8b9e8372-9f50-4471-9d67-44f486506536 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:52.817096 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8b9e8372-9f50-4471-9d67-44f486506536 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:52.817656 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8b9e8372-9f50-4471-9d67-44f486506536 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:52.818070 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8b9e8372-9f50-4471-9d67-44f486506536 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:52.818809 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8b9e8372-9f50-4471-9d67-44f486506536 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:52.819233 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8b9e8372-9f50-4471-9d67-44f486506536 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:52.819651 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8b9e8372-9f50-4471-9d67-44f486506536 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:53.036596 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-2ec2897c-7c11-4273-8366-f25c48875538 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:53.038993 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=100 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:53.047326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-2ec2897c-7c11-4273-8366-f25c48875538 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1521 microversion: 2.1 time: 0.267681 Aug 31 09:49:53.060831 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 138/262] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:52 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:53.061875 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-8b9e8372-9f50-4471-9d67-44f486506536 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:53.067859 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-8b9e8372-9f50-4471-9d67-44f486506536 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1368 microversion: 2.1 time: 0.263444 Aug 31 09:49:53.068471 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 125/263] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:52 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1368 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:53.260377 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-93c5b267-405c-4bd4-b6d1-a2608d152338 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:53.260992 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-93c5b267-405c-4bd4-b6d1-a2608d152338 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:53.267979 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-93c5b267-405c-4bd4-b6d1-a2608d152338 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:53.268465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-93c5b267-405c-4bd4-b6d1-a2608d152338 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:53.268896 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-93c5b267-405c-4bd4-b6d1-a2608d152338 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:53.269636 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-93c5b267-405c-4bd4-b6d1-a2608d152338 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:53.270088 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-93c5b267-405c-4bd4-b6d1-a2608d152338 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:53.270506 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-93c5b267-405c-4bd4-b6d1-a2608d152338 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:53.411285 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-93c5b267-405c-4bd4-b6d1-a2608d152338 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:53.419410 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-93c5b267-405c-4bd4-b6d1-a2608d152338 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1314 microversion: 2.1 time: 0.162858 Aug 31 09:49:53.420093 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 139/264] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:53 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:54.070888 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-ca592ef1-30c2-4bd3-8273-998a8c1548b7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:54.071669 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-ca592ef1-30c2-4bd3-8273-998a8c1548b7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:54.080009 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ca592ef1-30c2-4bd3-8273-998a8c1548b7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:54.080590 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ca592ef1-30c2-4bd3-8273-998a8c1548b7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:54.080954 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ca592ef1-30c2-4bd3-8273-998a8c1548b7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:54.081755 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ca592ef1-30c2-4bd3-8273-998a8c1548b7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:54.082324 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ca592ef1-30c2-4bd3-8273-998a8c1548b7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:54.082857 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ca592ef1-30c2-4bd3-8273-998a8c1548b7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:54.091023 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-35f42d0b-a407-4361-ac65-be8ba9166986 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:54.093250 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-35f42d0b-a407-4361-ac65-be8ba9166986 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:54.103237 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-35f42d0b-a407-4361-ac65-be8ba9166986 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:54.103839 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-35f42d0b-a407-4361-ac65-be8ba9166986 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:54.104279 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-35f42d0b-a407-4361-ac65-be8ba9166986 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:54.105093 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-35f42d0b-a407-4361-ac65-be8ba9166986 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:54.105601 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-35f42d0b-a407-4361-ac65-be8ba9166986 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:54.106022 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-35f42d0b-a407-4361-ac65-be8ba9166986 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:54.300346 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-ca592ef1-30c2-4bd3-8273-998a8c1548b7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:54.308872 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-ca592ef1-30c2-4bd3-8273-998a8c1548b7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1501 microversion: 2.1 time: 0.244337 Aug 31 09:49:54.309566 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 126/265] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:54 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1501 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:54.327531 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-35f42d0b-a407-4361-ac65-be8ba9166986 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:54.336880 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-35f42d0b-a407-4361-ac65-be8ba9166986 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1368 microversion: 2.1 time: 0.250194 Aug 31 09:49:54.337607 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 140/266] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:54 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1368 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:54.343258 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-3282ea60-1a5f-4530-925c-59f1a3053a0e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:54.343887 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-3282ea60-1a5f-4530-925c-59f1a3053a0e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:54.352794 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3282ea60-1a5f-4530-925c-59f1a3053a0e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:54.353372 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3282ea60-1a5f-4530-925c-59f1a3053a0e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:54.353931 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3282ea60-1a5f-4530-925c-59f1a3053a0e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:54.354741 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3282ea60-1a5f-4530-925c-59f1a3053a0e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:54.355194 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3282ea60-1a5f-4530-925c-59f1a3053a0e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:54.355622 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3282ea60-1a5f-4530-925c-59f1a3053a0e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:54.441827 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-e7150688-9db7-47c3-a3cf-e300c2de1d2e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:54.442677 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-e7150688-9db7-47c3-a3cf-e300c2de1d2e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:54.452105 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e7150688-9db7-47c3-a3cf-e300c2de1d2e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:54.452105 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e7150688-9db7-47c3-a3cf-e300c2de1d2e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:54.452751 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e7150688-9db7-47c3-a3cf-e300c2de1d2e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:54.454903 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e7150688-9db7-47c3-a3cf-e300c2de1d2e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:54.455972 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e7150688-9db7-47c3-a3cf-e300c2de1d2e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:54.456549 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e7150688-9db7-47c3-a3cf-e300c2de1d2e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:54.650309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-3282ea60-1a5f-4530-925c-59f1a3053a0e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:54.670176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-3282ea60-1a5f-4530-925c-59f1a3053a0e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1517 microversion: 2.1 time: 0.330451 Aug 31 09:49:54.672016 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 127/267] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:54 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1517 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:54.735312 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-e7150688-9db7-47c3-a3cf-e300c2de1d2e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:54.746649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-e7150688-9db7-47c3-a3cf-e300c2de1d2e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1314 microversion: 2.1 time: 0.309695 Aug 31 09:49:54.773425 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 141/268] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:54 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:55.387359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-5ffa3c84-aba5-4032-bf3c-b2fbf1be5a33 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:55.388524 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-5ffa3c84-aba5-4032-bf3c-b2fbf1be5a33 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:55.418518 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5ffa3c84-aba5-4032-bf3c-b2fbf1be5a33 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:55.419397 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5ffa3c84-aba5-4032-bf3c-b2fbf1be5a33 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:55.420184 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5ffa3c84-aba5-4032-bf3c-b2fbf1be5a33 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:55.421915 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5ffa3c84-aba5-4032-bf3c-b2fbf1be5a33 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:55.423007 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5ffa3c84-aba5-4032-bf3c-b2fbf1be5a33 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:55.423481 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5ffa3c84-aba5-4032-bf3c-b2fbf1be5a33 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:55.552393 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-991dd4ce-8584-4352-b685-05476306f9a2 req-d931d375-9162-4df3-9736-fd2ea1ca2fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3", "tag": "cc06604f-efa3-4b8c-a2d5-693ffb365876"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:55.567458 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-991dd4ce-8584-4352-b685-05476306f9a2 req-d931d375-9162-4df3-9736-fd2ea1ca2fc7 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:55.568238 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-991dd4ce-8584-4352-b685-05476306f9a2 req-d931d375-9162-4df3-9736-fd2ea1ca2fc7 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:55.568713 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-991dd4ce-8584-4352-b685-05476306f9a2 req-d931d375-9162-4df3-9736-fd2ea1ca2fc7 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:55.583530 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-991dd4ce-8584-4352-b685-05476306f9a2 req-d931d375-9162-4df3-9736-fd2ea1ca2fc7 service nova] Creating event network-changed:cc06604f-efa3-4b8c-a2d5-693ffb365876 for instance cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 on hv-cinder-84496 Aug 31 09:49:55.589841 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-991dd4ce-8584-4352-b685-05476306f9a2 req-d931d375-9162-4df3-9736-fd2ea1ca2fc7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043672 Aug 31 09:49:55.590891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 142/269] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:55.650562 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-5ffa3c84-aba5-4032-bf3c-b2fbf1be5a33 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:55.674586 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-5ffa3c84-aba5-4032-bf3c-b2fbf1be5a33 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1368 microversion: 2.1 time: 0.299177 Aug 31 09:49:55.689005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 128/270] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:55 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1368 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:55.801621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a2130aa2-0b2b-4db0-af3a-c024612f4fd1 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:55.802250 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-a2130aa2-0b2b-4db0-af3a-c024612f4fd1 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:55.808797 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a2130aa2-0b2b-4db0-af3a-c024612f4fd1 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:55.809551 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a2130aa2-0b2b-4db0-af3a-c024612f4fd1 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:55.810145 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a2130aa2-0b2b-4db0-af3a-c024612f4fd1 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:55.810855 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a2130aa2-0b2b-4db0-af3a-c024612f4fd1 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:55.811300 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a2130aa2-0b2b-4db0-af3a-c024612f4fd1 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:55.811721 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a2130aa2-0b2b-4db0-af3a-c024612f4fd1 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:56.035954 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-a2130aa2-0b2b-4db0-af3a-c024612f4fd1 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:56.047410 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a2130aa2-0b2b-4db0-af3a-c024612f4fd1 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1314 microversion: 2.1 time: 0.249920 Aug 31 09:49:56.048639 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 143/271] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:55 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:56.695910 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-fdf3ffc6-85f2-4247-8cf7-859e671d2b0f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:56.696699 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-fdf3ffc6-85f2-4247-8cf7-859e671d2b0f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:56.704360 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fdf3ffc6-85f2-4247-8cf7-859e671d2b0f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:56.705227 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fdf3ffc6-85f2-4247-8cf7-859e671d2b0f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:56.705691 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fdf3ffc6-85f2-4247-8cf7-859e671d2b0f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:56.706440 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fdf3ffc6-85f2-4247-8cf7-859e671d2b0f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:56.706893 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fdf3ffc6-85f2-4247-8cf7-859e671d2b0f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:56.707442 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fdf3ffc6-85f2-4247-8cf7-859e671d2b0f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:56.863082 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-fdf3ffc6-85f2-4247-8cf7-859e671d2b0f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:56.871433 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-fdf3ffc6-85f2-4247-8cf7-859e671d2b0f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1368 microversion: 2.1 time: 0.179419 Aug 31 09:49:56.872032 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 129/272] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:56 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:57.087459 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-c956f817-5cac-4263-b955-b729ba2a7b21 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:57.091635 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-c956f817-5cac-4263-b955-b729ba2a7b21 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:57.103673 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-b12cfd5a-4c06-4cba-ba51-7b3a233767c7 req-a5702bf6-3334-44f0-bbe8-aef5908c8b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74d01e00-bf25-4a74-b61e-b1503ad18c47", "name": "network-vif-plugged", "status": "completed", "tag": "cce2dbff-e77e-4c34-a575-46099f83471f"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:57.115312 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c956f817-5cac-4263-b955-b729ba2a7b21 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:57.127786 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-b12cfd5a-4c06-4cba-ba51-7b3a233767c7 req-a5702bf6-3334-44f0-bbe8-aef5908c8b8c service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:57.129156 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-b12cfd5a-4c06-4cba-ba51-7b3a233767c7 req-a5702bf6-3334-44f0-bbe8-aef5908c8b8c service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:57.130390 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-b12cfd5a-4c06-4cba-ba51-7b3a233767c7 req-a5702bf6-3334-44f0-bbe8-aef5908c8b8c service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:57.131240 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c956f817-5cac-4263-b955-b729ba2a7b21 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:57.132022 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c956f817-5cac-4263-b955-b729ba2a7b21 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:57.137003 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c956f817-5cac-4263-b955-b729ba2a7b21 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:57.138256 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c956f817-5cac-4263-b955-b729ba2a7b21 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:57.142179 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c956f817-5cac-4263-b955-b729ba2a7b21 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:57.159475 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-b12cfd5a-4c06-4cba-ba51-7b3a233767c7 req-a5702bf6-3334-44f0-bbe8-aef5908c8b8c service nova] Creating event network-vif-plugged:cce2dbff-e77e-4c34-a575-46099f83471f for instance 74d01e00-bf25-4a74-b61e-b1503ad18c47 on hv-cinder-84496 Aug 31 09:49:57.167804 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-b12cfd5a-4c06-4cba-ba51-7b3a233767c7 req-a5702bf6-3334-44f0-bbe8-aef5908c8b8c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075486 Aug 31 09:49:57.170265 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 130/273] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:57.615527 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-c956f817-5cac-4263-b955-b729ba2a7b21 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:57.620463 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-12a609a3-f46e-40de-8bad-d5ba3dd2d116 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:57.623102 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-12a609a3-f46e-40de-8bad-d5ba3dd2d116 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:57.623693 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-c956f817-5cac-4263-b955-b729ba2a7b21 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1314 microversion: 2.1 time: 0.543451 Aug 31 09:49:57.624453 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 144/274] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:57 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:57.625987 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:57.631790 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-12a609a3-f46e-40de-8bad-d5ba3dd2d116 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:57.632547 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-12a609a3-f46e-40de-8bad-d5ba3dd2d116 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:57.633090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-12a609a3-f46e-40de-8bad-d5ba3dd2d116 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:57.633968 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-12a609a3-f46e-40de-8bad-d5ba3dd2d116 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:57.634554 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-12a609a3-f46e-40de-8bad-d5ba3dd2d116 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:57.635103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-12a609a3-f46e-40de-8bad-d5ba3dd2d116 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:57.672078 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.objects.instance [None req-12a609a3-f46e-40de-8bad-d5ba3dd2d116 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lazy-loading 'flavor' on Instance uuid dd0a166f-d662-4a72-8ea2-bfbbb02b2221 {{(pid=127171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:49:57.816081 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-12a609a3-f46e-40de-8bad-d5ba3dd2d116 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "POST /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221/action" status: 200 len: 32 microversion: 2.1 time: 0.200221 Aug 31 09:49:57.816746 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 131/275] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 31 09:49:57 2022] POST /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221/action => generated 32 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 09:49:57.826199 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f2b97716-4fe2-474d-bb9b-5be88a51293d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:57.826813 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-f2b97716-4fe2-474d-bb9b-5be88a51293d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:57.834465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f2b97716-4fe2-474d-bb9b-5be88a51293d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:57.834951 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f2b97716-4fe2-474d-bb9b-5be88a51293d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:57.835377 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f2b97716-4fe2-474d-bb9b-5be88a51293d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:57.836085 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f2b97716-4fe2-474d-bb9b-5be88a51293d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:57.836531 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f2b97716-4fe2-474d-bb9b-5be88a51293d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:57.836946 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f2b97716-4fe2-474d-bb9b-5be88a51293d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:57.897829 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-aa1343a3-672b-4ebd-80a7-3f7a57dd4d37 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:57.899060 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-aa1343a3-672b-4ebd-80a7-3f7a57dd4d37 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:57.910423 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-aa1343a3-672b-4ebd-80a7-3f7a57dd4d37 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:57.911119 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-aa1343a3-672b-4ebd-80a7-3f7a57dd4d37 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:57.911591 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-aa1343a3-672b-4ebd-80a7-3f7a57dd4d37 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:57.912385 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-aa1343a3-672b-4ebd-80a7-3f7a57dd4d37 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:57.913067 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-aa1343a3-672b-4ebd-80a7-3f7a57dd4d37 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:57.913882 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-aa1343a3-672b-4ebd-80a7-3f7a57dd4d37 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:58.066526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-f2b97716-4fe2-474d-bb9b-5be88a51293d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:58.075062 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-f2b97716-4fe2-474d-bb9b-5be88a51293d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.252683 Aug 31 09:49:58.075649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 145/276] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:57 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:58.130456 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-aa1343a3-672b-4ebd-80a7-3f7a57dd4d37 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:58.139791 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-aa1343a3-672b-4ebd-80a7-3f7a57dd4d37 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1368 microversion: 2.1 time: 0.249694 Aug 31 09:49:58.140390 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 132/277] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:57 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1368 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:58.661532 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-4cfa35e7-2436-487c-8f7f-f41d73a25d33 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:58.662241 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-4cfa35e7-2436-487c-8f7f-f41d73a25d33 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:58.664466 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:58.671456 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4cfa35e7-2436-487c-8f7f-f41d73a25d33 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:58.671940 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4cfa35e7-2436-487c-8f7f-f41d73a25d33 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:58.672401 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4cfa35e7-2436-487c-8f7f-f41d73a25d33 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:58.673107 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4cfa35e7-2436-487c-8f7f-f41d73a25d33 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:58.673681 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4cfa35e7-2436-487c-8f7f-f41d73a25d33 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:58.674100 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4cfa35e7-2436-487c-8f7f-f41d73a25d33 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:58.882466 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-4cfa35e7-2436-487c-8f7f-f41d73a25d33 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:58.895573 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-4cfa35e7-2436-487c-8f7f-f41d73a25d33 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1314 microversion: 2.1 time: 0.238937 Aug 31 09:49:58.896916 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 146/278] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:58 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:59.102012 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-227e1d63-26ef-479a-ad3e-f3333fa2f16e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:59.102704 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-227e1d63-26ef-479a-ad3e-f3333fa2f16e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:59.111246 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-227e1d63-26ef-479a-ad3e-f3333fa2f16e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:59.111769 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-227e1d63-26ef-479a-ad3e-f3333fa2f16e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:59.112203 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-227e1d63-26ef-479a-ad3e-f3333fa2f16e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:59.112902 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-227e1d63-26ef-479a-ad3e-f3333fa2f16e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:59.113348 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-227e1d63-26ef-479a-ad3e-f3333fa2f16e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:59.113792 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-227e1d63-26ef-479a-ad3e-f3333fa2f16e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:59.166913 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-edc255db-8bfc-446d-a101-fd546cd8bb1f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:59.167539 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-edc255db-8bfc-446d-a101-fd546cd8bb1f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:59.175811 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-edc255db-8bfc-446d-a101-fd546cd8bb1f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:59.176370 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-edc255db-8bfc-446d-a101-fd546cd8bb1f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:59.176836 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-edc255db-8bfc-446d-a101-fd546cd8bb1f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:59.177711 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-edc255db-8bfc-446d-a101-fd546cd8bb1f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:59.178234 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-edc255db-8bfc-446d-a101-fd546cd8bb1f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:59.178691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-edc255db-8bfc-446d-a101-fd546cd8bb1f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:59.331556 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-227e1d63-26ef-479a-ad3e-f3333fa2f16e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:59.342178 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-227e1d63-26ef-479a-ad3e-f3333fa2f16e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.244693 Aug 31 09:49:59.343668 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 133/279] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:59 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:59.372437 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-edc255db-8bfc-446d-a101-fd546cd8bb1f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:59.384663 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-edc255db-8bfc-446d-a101-fd546cd8bb1f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1368 microversion: 2.1 time: 0.221249 Aug 31 09:49:59.385705 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 147/280] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:59 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:59.921891 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-0a3da796-993d-437e-b29f-c3381801d6a7 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:59.923721 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-0a3da796-993d-437e-b29f-c3381801d6a7 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:59.935208 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0a3da796-993d-437e-b29f-c3381801d6a7 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:59.936074 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0a3da796-993d-437e-b29f-c3381801d6a7 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:59.936849 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0a3da796-993d-437e-b29f-c3381801d6a7 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:59.938950 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0a3da796-993d-437e-b29f-c3381801d6a7 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:59.939661 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0a3da796-993d-437e-b29f-c3381801d6a7 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:59.940430 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0a3da796-993d-437e-b29f-c3381801d6a7 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:00.144597 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-0a3da796-993d-437e-b29f-c3381801d6a7 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:00.155560 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-0a3da796-993d-437e-b29f-c3381801d6a7 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1314 microversion: 2.1 time: 0.241129 Aug 31 09:50:00.158520 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 134/281] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:59 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:00.379440 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-6585a9db-7ffa-4355-ae1d-4651eec29214 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:00.380539 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-6585a9db-7ffa-4355-ae1d-4651eec29214 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:00.391457 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6585a9db-7ffa-4355-ae1d-4651eec29214 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:00.392348 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6585a9db-7ffa-4355-ae1d-4651eec29214 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:00.395843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6585a9db-7ffa-4355-ae1d-4651eec29214 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:00.395843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6585a9db-7ffa-4355-ae1d-4651eec29214 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:00.395843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6585a9db-7ffa-4355-ae1d-4651eec29214 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:00.400402 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6585a9db-7ffa-4355-ae1d-4651eec29214 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:00.412551 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-cd80652c-693b-4d37-b0d7-f09fa00ab585 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:00.413810 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-cd80652c-693b-4d37-b0d7-f09fa00ab585 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:00.425710 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cd80652c-693b-4d37-b0d7-f09fa00ab585 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:00.426049 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cd80652c-693b-4d37-b0d7-f09fa00ab585 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:00.426584 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cd80652c-693b-4d37-b0d7-f09fa00ab585 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:00.427205 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cd80652c-693b-4d37-b0d7-f09fa00ab585 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:00.427664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cd80652c-693b-4d37-b0d7-f09fa00ab585 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:00.428082 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cd80652c-693b-4d37-b0d7-f09fa00ab585 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:00.647189 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-cd80652c-693b-4d37-b0d7-f09fa00ab585 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:00.648839 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-6585a9db-7ffa-4355-ae1d-4651eec29214 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:00.660103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:00.675456 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-6585a9db-7ffa-4355-ae1d-4651eec29214 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.304162 Aug 31 09:50:00.676063 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 148/282] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:00 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:00.677441 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-cd80652c-693b-4d37-b0d7-f09fa00ab585 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1368 microversion: 2.1 time: 0.272848 Aug 31 09:50:00.678301 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 135/283] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:00 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1368 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:01.192806 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a6f9d80a-b756-43db-8c4f-e34eed9c59de tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:01.193625 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-a6f9d80a-b756-43db-8c4f-e34eed9c59de tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:01.199955 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a6f9d80a-b756-43db-8c4f-e34eed9c59de tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:01.200441 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a6f9d80a-b756-43db-8c4f-e34eed9c59de tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:01.200875 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a6f9d80a-b756-43db-8c4f-e34eed9c59de tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:01.201617 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a6f9d80a-b756-43db-8c4f-e34eed9c59de tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:01.202064 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a6f9d80a-b756-43db-8c4f-e34eed9c59de tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:01.202474 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a6f9d80a-b756-43db-8c4f-e34eed9c59de tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:01.351290 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-a6f9d80a-b756-43db-8c4f-e34eed9c59de tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:01.366329 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a6f9d80a-b756-43db-8c4f-e34eed9c59de tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1314 microversion: 2.1 time: 0.177486 Aug 31 09:50:01.367365 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 149/284] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:01 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:01.699465 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-33f8099b-770f-4ae3-8f15-dda4fe4c1d4e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:01.700321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-d867df52-1f2e-41f5-a1aa-a35ef2d7d13d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:01.700886 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-33f8099b-770f-4ae3-8f15-dda4fe4c1d4e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:01.701058 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-d867df52-1f2e-41f5-a1aa-a35ef2d7d13d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:01.708604 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d867df52-1f2e-41f5-a1aa-a35ef2d7d13d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:01.709415 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d867df52-1f2e-41f5-a1aa-a35ef2d7d13d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:01.709997 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d867df52-1f2e-41f5-a1aa-a35ef2d7d13d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:01.710725 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d867df52-1f2e-41f5-a1aa-a35ef2d7d13d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:01.711646 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d867df52-1f2e-41f5-a1aa-a35ef2d7d13d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:01.712167 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-33f8099b-770f-4ae3-8f15-dda4fe4c1d4e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:01.712546 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d867df52-1f2e-41f5-a1aa-a35ef2d7d13d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:01.712843 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-33f8099b-770f-4ae3-8f15-dda4fe4c1d4e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:01.713080 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-33f8099b-770f-4ae3-8f15-dda4fe4c1d4e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:01.713824 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-33f8099b-770f-4ae3-8f15-dda4fe4c1d4e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:01.714464 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-33f8099b-770f-4ae3-8f15-dda4fe4c1d4e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:01.715046 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-33f8099b-770f-4ae3-8f15-dda4fe4c1d4e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:02.016919 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-d867df52-1f2e-41f5-a1aa-a35ef2d7d13d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:02.029184 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-d867df52-1f2e-41f5-a1aa-a35ef2d7d13d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1368 microversion: 2.1 time: 0.332651 Aug 31 09:50:02.032147 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 150/285] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:01 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1368 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:02.161132 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-33f8099b-770f-4ae3-8f15-dda4fe4c1d4e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:02.176997 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-33f8099b-770f-4ae3-8f15-dda4fe4c1d4e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.480695 Aug 31 09:50:02.178222 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 136/286] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:01 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:02.388870 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-c8eff684-ef3c-4f56-8120-fab6204a5226 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:02.390229 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-c8eff684-ef3c-4f56-8120-fab6204a5226 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:02.397924 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8eff684-ef3c-4f56-8120-fab6204a5226 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:02.398446 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8eff684-ef3c-4f56-8120-fab6204a5226 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:02.398864 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8eff684-ef3c-4f56-8120-fab6204a5226 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:02.399772 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8eff684-ef3c-4f56-8120-fab6204a5226 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:02.400234 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8eff684-ef3c-4f56-8120-fab6204a5226 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:02.400655 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8eff684-ef3c-4f56-8120-fab6204a5226 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:02.616380 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-c8eff684-ef3c-4f56-8120-fab6204a5226 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:02.626205 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-c8eff684-ef3c-4f56-8120-fab6204a5226 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1314 microversion: 2.1 time: 0.241465 Aug 31 09:50:02.627221 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 151/287] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:02 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:03.057917 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-bd938c3f-8947-4da9-909a-1191fe34bdba tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:03.058770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-bd938c3f-8947-4da9-909a-1191fe34bdba tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:03.069108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-bd938c3f-8947-4da9-909a-1191fe34bdba tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:03.070077 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-bd938c3f-8947-4da9-909a-1191fe34bdba tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:03.070835 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-bd938c3f-8947-4da9-909a-1191fe34bdba tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:03.071813 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-bd938c3f-8947-4da9-909a-1191fe34bdba tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:03.072607 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-bd938c3f-8947-4da9-909a-1191fe34bdba tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:03.073334 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-bd938c3f-8947-4da9-909a-1191fe34bdba tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:03.215026 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-548d702d-9fc2-4716-8f61-0204c90c3e6c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:03.216610 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-548d702d-9fc2-4716-8f61-0204c90c3e6c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:03.231833 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-548d702d-9fc2-4716-8f61-0204c90c3e6c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:03.232575 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-548d702d-9fc2-4716-8f61-0204c90c3e6c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:03.233432 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-548d702d-9fc2-4716-8f61-0204c90c3e6c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:03.235498 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-548d702d-9fc2-4716-8f61-0204c90c3e6c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:03.236528 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-548d702d-9fc2-4716-8f61-0204c90c3e6c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:03.237461 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-548d702d-9fc2-4716-8f61-0204c90c3e6c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:03.349898 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-bd938c3f-8947-4da9-909a-1191fe34bdba tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:03.366229 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-bd938c3f-8947-4da9-909a-1191fe34bdba tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1368 microversion: 2.1 time: 0.311789 Aug 31 09:50:03.368032 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 137/288] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:03 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1368 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:03.493178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-548d702d-9fc2-4716-8f61-0204c90c3e6c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:03.506445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-548d702d-9fc2-4716-8f61-0204c90c3e6c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.296727 Aug 31 09:50:03.506445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 152/289] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:03 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:03.649150 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c9077562-99f7-4b5c-8731-85ab69abaf7e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:03.649804 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c9077562-99f7-4b5c-8731-85ab69abaf7e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:03.656300 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c9077562-99f7-4b5c-8731-85ab69abaf7e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:03.658423 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c9077562-99f7-4b5c-8731-85ab69abaf7e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:03.658648 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c9077562-99f7-4b5c-8731-85ab69abaf7e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:03.659558 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c9077562-99f7-4b5c-8731-85ab69abaf7e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:03.660231 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c9077562-99f7-4b5c-8731-85ab69abaf7e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:03.660659 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c9077562-99f7-4b5c-8731-85ab69abaf7e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:03.887097 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c9077562-99f7-4b5c-8731-85ab69abaf7e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:03.899301 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c9077562-99f7-4b5c-8731-85ab69abaf7e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1314 microversion: 2.1 time: 0.253970 Aug 31 09:50:03.900679 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 138/290] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:03 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:04.398787 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-e84c6f6c-c3de-4d6d-8087-eb37a14883a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:04.399554 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-e84c6f6c-c3de-4d6d-8087-eb37a14883a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:04.406121 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e84c6f6c-c3de-4d6d-8087-eb37a14883a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:04.406822 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e84c6f6c-c3de-4d6d-8087-eb37a14883a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:04.407725 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e84c6f6c-c3de-4d6d-8087-eb37a14883a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:04.407969 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e84c6f6c-c3de-4d6d-8087-eb37a14883a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:04.408422 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e84c6f6c-c3de-4d6d-8087-eb37a14883a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:04.408841 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e84c6f6c-c3de-4d6d-8087-eb37a14883a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:04.528235 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-6b358635-9b62-4729-862d-074c40b678bd tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:04.529416 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-6b358635-9b62-4729-862d-074c40b678bd tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:04.540839 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6b358635-9b62-4729-862d-074c40b678bd tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:04.541586 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6b358635-9b62-4729-862d-074c40b678bd tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:04.542200 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6b358635-9b62-4729-862d-074c40b678bd tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:04.543626 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6b358635-9b62-4729-862d-074c40b678bd tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:04.544470 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6b358635-9b62-4729-862d-074c40b678bd tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:04.545235 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6b358635-9b62-4729-862d-074c40b678bd tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:04.572551 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-e84c6f6c-c3de-4d6d-8087-eb37a14883a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:04.582247 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-e84c6f6c-c3de-4d6d-8087-eb37a14883a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1368 microversion: 2.1 time: 0.187118 Aug 31 09:50:04.597103 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 153/291] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:04 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:04.746536 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-6b358635-9b62-4729-862d-074c40b678bd tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:04.757971 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-6b358635-9b62-4729-862d-074c40b678bd tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.237143 Aug 31 09:50:04.759025 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 139/292] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:04 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:04.936876 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a73a4348-30d9-445e-a32c-61edbcb7026d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:04.938237 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-a73a4348-30d9-445e-a32c-61edbcb7026d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:04.946289 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a73a4348-30d9-445e-a32c-61edbcb7026d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:04.947089 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a73a4348-30d9-445e-a32c-61edbcb7026d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:04.948163 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a73a4348-30d9-445e-a32c-61edbcb7026d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:04.949196 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a73a4348-30d9-445e-a32c-61edbcb7026d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:04.950233 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a73a4348-30d9-445e-a32c-61edbcb7026d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:04.950810 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a73a4348-30d9-445e-a32c-61edbcb7026d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:05.215739 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-a73a4348-30d9-445e-a32c-61edbcb7026d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:05.225074 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a73a4348-30d9-445e-a32c-61edbcb7026d tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1314 microversion: 2.1 time: 0.293148 Aug 31 09:50:05.225703 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 154/293] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:04 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:05.609474 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9ce69afb-de1b-4d94-85ce-f43b32ae5af4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:05.610507 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-9ce69afb-de1b-4d94-85ce-f43b32ae5af4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:05.623991 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9ce69afb-de1b-4d94-85ce-f43b32ae5af4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:05.625590 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9ce69afb-de1b-4d94-85ce-f43b32ae5af4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:05.626390 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9ce69afb-de1b-4d94-85ce-f43b32ae5af4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:05.627677 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9ce69afb-de1b-4d94-85ce-f43b32ae5af4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:05.628512 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9ce69afb-de1b-4d94-85ce-f43b32ae5af4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:05.629280 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9ce69afb-de1b-4d94-85ce-f43b32ae5af4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:05.797919 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-d9aa50b1-7dce-4a9b-a566-944fd0bd9ceb tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:05.799061 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-d9aa50b1-7dce-4a9b-a566-944fd0bd9ceb tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:05.810172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d9aa50b1-7dce-4a9b-a566-944fd0bd9ceb tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:05.811023 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d9aa50b1-7dce-4a9b-a566-944fd0bd9ceb tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:05.811753 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d9aa50b1-7dce-4a9b-a566-944fd0bd9ceb tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:05.813068 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d9aa50b1-7dce-4a9b-a566-944fd0bd9ceb tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:05.813691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d9aa50b1-7dce-4a9b-a566-944fd0bd9ceb tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:05.814211 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d9aa50b1-7dce-4a9b-a566-944fd0bd9ceb tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:05.815727 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-9ce69afb-de1b-4d94-85ce-f43b32ae5af4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:05.831068 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-9ce69afb-de1b-4d94-85ce-f43b32ae5af4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1368 microversion: 2.1 time: 0.228420 Aug 31 09:50:05.832017 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 140/294] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:05 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:06.043502 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-d9aa50b1-7dce-4a9b-a566-944fd0bd9ceb tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:06.059001 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-d9aa50b1-7dce-4a9b-a566-944fd0bd9ceb tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.268086 Aug 31 09:50:06.059946 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 155/295] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:05 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:06.246692 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-0539d20c-62e0-47bf-aee5-64c9abf7eab1 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:06.247373 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-0539d20c-62e0-47bf-aee5-64c9abf7eab1 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:06.254212 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0539d20c-62e0-47bf-aee5-64c9abf7eab1 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:06.254681 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0539d20c-62e0-47bf-aee5-64c9abf7eab1 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:06.255107 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0539d20c-62e0-47bf-aee5-64c9abf7eab1 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:06.255805 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0539d20c-62e0-47bf-aee5-64c9abf7eab1 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:06.256246 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0539d20c-62e0-47bf-aee5-64c9abf7eab1 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:06.256657 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0539d20c-62e0-47bf-aee5-64c9abf7eab1 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:06.415765 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-0539d20c-62e0-47bf-aee5-64c9abf7eab1 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:06.425254 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-0539d20c-62e0-47bf-aee5-64c9abf7eab1 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1314 microversion: 2.1 time: 0.182380 Aug 31 09:50:06.425896 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 141/296] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:06 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:06.856242 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-87c510ea-7976-4968-88ed-5920ed540585 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:06.857421 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-87c510ea-7976-4968-88ed-5920ed540585 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:06.867577 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-87c510ea-7976-4968-88ed-5920ed540585 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:06.868168 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-87c510ea-7976-4968-88ed-5920ed540585 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:06.868896 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-87c510ea-7976-4968-88ed-5920ed540585 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:06.869703 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-87c510ea-7976-4968-88ed-5920ed540585 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:06.870201 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-87c510ea-7976-4968-88ed-5920ed540585 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:06.870636 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-87c510ea-7976-4968-88ed-5920ed540585 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:06.873528 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=100 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:07.061956 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-87c510ea-7976-4968-88ed-5920ed540585 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:07.071443 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-87c510ea-7976-4968-88ed-5920ed540585 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1368 microversion: 2.1 time: 0.221377 Aug 31 09:50:07.072052 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 156/297] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:06 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:07.092056 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-fe24b99b-f942-47d2-8244-c8840c966e86 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:07.093086 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-fe24b99b-f942-47d2-8244-c8840c966e86 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:07.101721 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fe24b99b-f942-47d2-8244-c8840c966e86 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:07.102222 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fe24b99b-f942-47d2-8244-c8840c966e86 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:07.102658 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fe24b99b-f942-47d2-8244-c8840c966e86 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:07.103383 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fe24b99b-f942-47d2-8244-c8840c966e86 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:07.103847 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fe24b99b-f942-47d2-8244-c8840c966e86 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:07.104277 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fe24b99b-f942-47d2-8244-c8840c966e86 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:07.343591 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-fe24b99b-f942-47d2-8244-c8840c966e86 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:07.354073 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-fe24b99b-f942-47d2-8244-c8840c966e86 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.276094 Aug 31 09:50:07.354968 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 142/298] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:07 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:07.446289 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-38961c15-0437-42bb-85d5-8510b0238e7f tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:07.446990 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-38961c15-0437-42bb-85d5-8510b0238e7f tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:07.454906 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-38961c15-0437-42bb-85d5-8510b0238e7f tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:07.455374 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-38961c15-0437-42bb-85d5-8510b0238e7f tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:07.455838 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-38961c15-0437-42bb-85d5-8510b0238e7f tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:07.456613 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-38961c15-0437-42bb-85d5-8510b0238e7f tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:07.457087 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-38961c15-0437-42bb-85d5-8510b0238e7f tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:07.457546 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-38961c15-0437-42bb-85d5-8510b0238e7f tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:07.628973 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-38961c15-0437-42bb-85d5-8510b0238e7f tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:07.642035 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-38961c15-0437-42bb-85d5-8510b0238e7f tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1314 microversion: 2.1 time: 0.199565 Aug 31 09:50:07.643017 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 157/299] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:07 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:08.104819 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c2abfa1e-e2b6-406f-80a6-8e3e2b6073e4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:08.105445 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c2abfa1e-e2b6-406f-80a6-8e3e2b6073e4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:08.117326 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c2abfa1e-e2b6-406f-80a6-8e3e2b6073e4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:08.117858 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c2abfa1e-e2b6-406f-80a6-8e3e2b6073e4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:08.118295 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c2abfa1e-e2b6-406f-80a6-8e3e2b6073e4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:08.119009 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c2abfa1e-e2b6-406f-80a6-8e3e2b6073e4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:08.119462 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c2abfa1e-e2b6-406f-80a6-8e3e2b6073e4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:08.119889 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c2abfa1e-e2b6-406f-80a6-8e3e2b6073e4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:08.300989 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c2abfa1e-e2b6-406f-80a6-8e3e2b6073e4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:08.309167 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c2abfa1e-e2b6-406f-80a6-8e3e2b6073e4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1368 microversion: 2.1 time: 0.208669 Aug 31 09:50:08.309784 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 143/300] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:08 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1368 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:08.392170 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-65f801ef-482c-46e2-b599-1dae40f77516 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:08.393409 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-65f801ef-482c-46e2-b599-1dae40f77516 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:08.401900 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-65f801ef-482c-46e2-b599-1dae40f77516 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:08.402668 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-65f801ef-482c-46e2-b599-1dae40f77516 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:08.403106 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-65f801ef-482c-46e2-b599-1dae40f77516 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:08.403822 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-65f801ef-482c-46e2-b599-1dae40f77516 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:08.404310 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-65f801ef-482c-46e2-b599-1dae40f77516 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:08.404733 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-65f801ef-482c-46e2-b599-1dae40f77516 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:08.653880 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-65f801ef-482c-46e2-b599-1dae40f77516 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:08.663748 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-85e6152d-252d-4bee-a9fa-e61661340d6a tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:08.664452 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-65f801ef-482c-46e2-b599-1dae40f77516 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.279095 Aug 31 09:50:08.665087 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-85e6152d-252d-4bee-a9fa-e61661340d6a tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:08.669729 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 158/301] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:08 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:08.681734 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-85e6152d-252d-4bee-a9fa-e61661340d6a tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:08.682496 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-85e6152d-252d-4bee-a9fa-e61661340d6a tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:08.683031 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-85e6152d-252d-4bee-a9fa-e61661340d6a tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:08.684317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-85e6152d-252d-4bee-a9fa-e61661340d6a tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:08.685089 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-85e6152d-252d-4bee-a9fa-e61661340d6a tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:08.685858 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-85e6152d-252d-4bee-a9fa-e61661340d6a tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:08.854956 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-85e6152d-252d-4bee-a9fa-e61661340d6a tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:08.866474 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-85e6152d-252d-4bee-a9fa-e61661340d6a tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1314 microversion: 2.1 time: 0.206382 Aug 31 09:50:08.867104 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 144/302] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:08 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:09.332498 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-c36596ca-fecb-4750-8236-06c72456c5b5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:09.333151 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-c36596ca-fecb-4750-8236-06c72456c5b5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:09.343078 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c36596ca-fecb-4750-8236-06c72456c5b5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:09.344584 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c36596ca-fecb-4750-8236-06c72456c5b5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:09.345522 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c36596ca-fecb-4750-8236-06c72456c5b5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:09.347204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c36596ca-fecb-4750-8236-06c72456c5b5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:09.348074 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c36596ca-fecb-4750-8236-06c72456c5b5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:09.348912 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c36596ca-fecb-4750-8236-06c72456c5b5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:09.551932 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-c36596ca-fecb-4750-8236-06c72456c5b5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:09.560269 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-c36596ca-fecb-4750-8236-06c72456c5b5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1368 microversion: 2.1 time: 0.232016 Aug 31 09:50:09.560992 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 159/303] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:09 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:09.644058 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-c5f2f66a-287a-4a3b-b30b-4fa659e72954 req-a5416807-aa57-4892-ba00-fa990964e291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3", "name": "network-vif-plugged", "status": "completed", "tag": "cc06604f-efa3-4b8c-a2d5-693ffb365876"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:09.655926 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-c5f2f66a-287a-4a3b-b30b-4fa659e72954 req-a5416807-aa57-4892-ba00-fa990964e291 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:09.657263 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-c5f2f66a-287a-4a3b-b30b-4fa659e72954 req-a5416807-aa57-4892-ba00-fa990964e291 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:09.657563 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-c5f2f66a-287a-4a3b-b30b-4fa659e72954 req-a5416807-aa57-4892-ba00-fa990964e291 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:09.671016 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-c5f2f66a-287a-4a3b-b30b-4fa659e72954 req-a5416807-aa57-4892-ba00-fa990964e291 service nova] Creating event network-vif-plugged:cc06604f-efa3-4b8c-a2d5-693ffb365876 for instance cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 on hv-cinder-84496 Aug 31 09:50:09.680233 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-c5f2f66a-287a-4a3b-b30b-4fa659e72954 req-a5416807-aa57-4892-ba00-fa990964e291 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041082 Aug 31 09:50:09.681347 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 145/304] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:50:09.694629 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-8aa4adf2-ca44-4778-b245-f64dc5db0b15 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:09.695721 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-8aa4adf2-ca44-4778-b245-f64dc5db0b15 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:09.704747 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8aa4adf2-ca44-4778-b245-f64dc5db0b15 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:09.705299 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8aa4adf2-ca44-4778-b245-f64dc5db0b15 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:09.706286 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8aa4adf2-ca44-4778-b245-f64dc5db0b15 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:09.707315 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8aa4adf2-ca44-4778-b245-f64dc5db0b15 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:09.707993 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8aa4adf2-ca44-4778-b245-f64dc5db0b15 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:09.708629 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8aa4adf2-ca44-4778-b245-f64dc5db0b15 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:09.872845 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-8aa4adf2-ca44-4778-b245-f64dc5db0b15 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:09.881647 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-8aa4adf2-ca44-4778-b245-f64dc5db0b15 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.198036 Aug 31 09:50:09.882230 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 160/305] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:09 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:09.890359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c17cb51d-773c-439d-a678-9fd9236d868c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:09.891619 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c17cb51d-773c-439d-a678-9fd9236d868c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:09.898826 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c17cb51d-773c-439d-a678-9fd9236d868c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:09.899314 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c17cb51d-773c-439d-a678-9fd9236d868c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:09.899753 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c17cb51d-773c-439d-a678-9fd9236d868c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:09.900466 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c17cb51d-773c-439d-a678-9fd9236d868c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:09.900916 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c17cb51d-773c-439d-a678-9fd9236d868c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:09.901336 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c17cb51d-773c-439d-a678-9fd9236d868c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:10.061039 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c17cb51d-773c-439d-a678-9fd9236d868c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:10.074116 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c17cb51d-773c-439d-a678-9fd9236d868c tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1499 microversion: 2.1 time: 0.187289 Aug 31 09:50:10.074874 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 146/306] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:09 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1499 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:10.584788 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-abc9b8bc-154b-4b56-b9d2-cd7f10575d9e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:10.585885 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-abc9b8bc-154b-4b56-b9d2-cd7f10575d9e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:10.592730 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-abc9b8bc-154b-4b56-b9d2-cd7f10575d9e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:10.593206 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-abc9b8bc-154b-4b56-b9d2-cd7f10575d9e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:10.594307 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-abc9b8bc-154b-4b56-b9d2-cd7f10575d9e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:10.595082 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-abc9b8bc-154b-4b56-b9d2-cd7f10575d9e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:10.595522 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-abc9b8bc-154b-4b56-b9d2-cd7f10575d9e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:10.595933 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-abc9b8bc-154b-4b56-b9d2-cd7f10575d9e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:10.742336 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-abc9b8bc-154b-4b56-b9d2-cd7f10575d9e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:10.751060 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-abc9b8bc-154b-4b56-b9d2-cd7f10575d9e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1368 microversion: 2.1 time: 0.171813 Aug 31 09:50:10.751793 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 161/307] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:10 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:10.903587 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-be8d88cd-d57f-46eb-9ef7-b585665cea5d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:10.904184 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-be8d88cd-d57f-46eb-9ef7-b585665cea5d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:10.911228 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be8d88cd-d57f-46eb-9ef7-b585665cea5d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:10.911714 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be8d88cd-d57f-46eb-9ef7-b585665cea5d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:10.912173 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be8d88cd-d57f-46eb-9ef7-b585665cea5d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:10.912861 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be8d88cd-d57f-46eb-9ef7-b585665cea5d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:10.913492 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be8d88cd-d57f-46eb-9ef7-b585665cea5d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:10.913920 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be8d88cd-d57f-46eb-9ef7-b585665cea5d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:11.073647 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-be8d88cd-d57f-46eb-9ef7-b585665cea5d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:11.085267 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-be8d88cd-d57f-46eb-9ef7-b585665cea5d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.185390 Aug 31 09:50:11.085906 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 147/308] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:10 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:11.778294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-163010ed-ed3f-499b-b0fc-3b8d4a970425 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:11.779188 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-163010ed-ed3f-499b-b0fc-3b8d4a970425 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:11.788949 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-163010ed-ed3f-499b-b0fc-3b8d4a970425 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:11.789716 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-163010ed-ed3f-499b-b0fc-3b8d4a970425 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:11.790419 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-163010ed-ed3f-499b-b0fc-3b8d4a970425 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:11.791588 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-163010ed-ed3f-499b-b0fc-3b8d4a970425 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:11.792362 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-163010ed-ed3f-499b-b0fc-3b8d4a970425 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:11.793058 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-163010ed-ed3f-499b-b0fc-3b8d4a970425 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:12.040596 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-163010ed-ed3f-499b-b0fc-3b8d4a970425 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:12.050106 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-163010ed-ed3f-499b-b0fc-3b8d4a970425 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1368 microversion: 2.1 time: 0.278478 Aug 31 09:50:12.050710 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 162/309] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:11 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1368 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:12.108629 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9a00eedd-d700-4caf-a1d0-d4d2c0f0a9b4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:12.111376 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-9a00eedd-d700-4caf-a1d0-d4d2c0f0a9b4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:12.118873 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9a00eedd-d700-4caf-a1d0-d4d2c0f0a9b4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:12.119341 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9a00eedd-d700-4caf-a1d0-d4d2c0f0a9b4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:12.119775 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9a00eedd-d700-4caf-a1d0-d4d2c0f0a9b4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:12.120479 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9a00eedd-d700-4caf-a1d0-d4d2c0f0a9b4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:12.120978 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9a00eedd-d700-4caf-a1d0-d4d2c0f0a9b4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:12.121620 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9a00eedd-d700-4caf-a1d0-d4d2c0f0a9b4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:12.357414 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-9a00eedd-d700-4caf-a1d0-d4d2c0f0a9b4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:12.369005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-9a00eedd-d700-4caf-a1d0-d4d2c0f0a9b4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.264153 Aug 31 09:50:12.369837 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 148/310] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:12 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:13.087776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-9770fc8c-cd1a-4100-af4b-98cd7e4d4989 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:13.088419 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-9770fc8c-cd1a-4100-af4b-98cd7e4d4989 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:13.095785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9770fc8c-cd1a-4100-af4b-98cd7e4d4989 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:13.096479 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9770fc8c-cd1a-4100-af4b-98cd7e4d4989 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:13.096804 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9770fc8c-cd1a-4100-af4b-98cd7e4d4989 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:13.097630 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9770fc8c-cd1a-4100-af4b-98cd7e4d4989 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:13.098274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9770fc8c-cd1a-4100-af4b-98cd7e4d4989 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:13.098769 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9770fc8c-cd1a-4100-af4b-98cd7e4d4989 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:13.264989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-9770fc8c-cd1a-4100-af4b-98cd7e4d4989 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:13.278294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-9770fc8c-cd1a-4100-af4b-98cd7e4d4989 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1368 microversion: 2.1 time: 0.196851 Aug 31 09:50:13.279255 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 163/311] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:13 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1368 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:13.395376 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-0e14518b-f6e8-40cf-b508-9adabc6e901f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:13.397133 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-0e14518b-f6e8-40cf-b508-9adabc6e901f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:13.404437 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0e14518b-f6e8-40cf-b508-9adabc6e901f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:13.404918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0e14518b-f6e8-40cf-b508-9adabc6e901f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:13.405345 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0e14518b-f6e8-40cf-b508-9adabc6e901f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:13.406108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0e14518b-f6e8-40cf-b508-9adabc6e901f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:13.407222 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0e14518b-f6e8-40cf-b508-9adabc6e901f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:13.407840 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0e14518b-f6e8-40cf-b508-9adabc6e901f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:13.488557 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-bf0c1b36-fa76-41e0-8762-046c0a78731e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:13.489330 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-bf0c1b36-fa76-41e0-8762-046c0a78731e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:13.496210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bf0c1b36-fa76-41e0-8762-046c0a78731e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:13.496773 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bf0c1b36-fa76-41e0-8762-046c0a78731e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:13.497428 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bf0c1b36-fa76-41e0-8762-046c0a78731e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:13.498282 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bf0c1b36-fa76-41e0-8762-046c0a78731e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:13.498902 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bf0c1b36-fa76-41e0-8762-046c0a78731e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:13.499727 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bf0c1b36-fa76-41e0-8762-046c0a78731e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:13.539407 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-bf0c1b36-fa76-41e0-8762-046c0a78731e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Going to try to terminate instance {{(pid=127170) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:50:13.614468 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-0e14518b-f6e8-40cf-b508-9adabc6e901f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:13.628167 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-0e14518b-f6e8-40cf-b508-9adabc6e901f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.236673 Aug 31 09:50:13.629550 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 149/312] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:13 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:13.668862 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-bf0c1b36-fa76-41e0-8762-046c0a78731e tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "DELETE /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 204 len: 0 microversion: 2.1 time: 0.185958 Aug 31 09:50:13.669589 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 164/313] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 09:50:13 2022] DELETE /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:50:13.678670 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-a0fc4b3f-1b46-4097-a8ee-5243488f02d2 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:13.679272 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-a0fc4b3f-1b46-4097-a8ee-5243488f02d2 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:13.685179 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a0fc4b3f-1b46-4097-a8ee-5243488f02d2 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:13.685697 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a0fc4b3f-1b46-4097-a8ee-5243488f02d2 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:13.686130 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a0fc4b3f-1b46-4097-a8ee-5243488f02d2 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:13.686825 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a0fc4b3f-1b46-4097-a8ee-5243488f02d2 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:13.687912 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a0fc4b3f-1b46-4097-a8ee-5243488f02d2 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:13.688546 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a0fc4b3f-1b46-4097-a8ee-5243488f02d2 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:13.853824 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-a0fc4b3f-1b46-4097-a8ee-5243488f02d2 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:13.868283 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-a0fc4b3f-1b46-4097-a8ee-5243488f02d2 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1505 microversion: 2.1 time: 0.192425 Aug 31 09:50:13.869799 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 150/314] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:13 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:14.303228 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-ad613b44-f60b-47fb-bcd1-a2c59f424576 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:14.303915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-ad613b44-f60b-47fb-bcd1-a2c59f424576 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:14.310819 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ad613b44-f60b-47fb-bcd1-a2c59f424576 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:14.312237 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ad613b44-f60b-47fb-bcd1-a2c59f424576 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:14.312237 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ad613b44-f60b-47fb-bcd1-a2c59f424576 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:14.312653 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ad613b44-f60b-47fb-bcd1-a2c59f424576 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:14.313104 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ad613b44-f60b-47fb-bcd1-a2c59f424576 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:14.313555 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ad613b44-f60b-47fb-bcd1-a2c59f424576 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:14.515126 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-ad613b44-f60b-47fb-bcd1-a2c59f424576 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:14.529881 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-ad613b44-f60b-47fb-bcd1-a2c59f424576 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1557 microversion: 2.1 time: 0.230370 Aug 31 09:50:14.530630 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 165/315] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:14 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1557 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:14.552649 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-dce4a6e6-ad64-4215-b2ad-8df33e0ef4d4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:14.553761 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-dce4a6e6-ad64-4215-b2ad-8df33e0ef4d4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:14.560779 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dce4a6e6-ad64-4215-b2ad-8df33e0ef4d4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:14.561620 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dce4a6e6-ad64-4215-b2ad-8df33e0ef4d4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:14.563133 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dce4a6e6-ad64-4215-b2ad-8df33e0ef4d4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:14.564381 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dce4a6e6-ad64-4215-b2ad-8df33e0ef4d4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:14.565303 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dce4a6e6-ad64-4215-b2ad-8df33e0ef4d4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:14.566003 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dce4a6e6-ad64-4215-b2ad-8df33e0ef4d4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:14.654147 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-6a1767fd-d1e9-46da-9ffe-81498b6730a0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:14.655565 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-6a1767fd-d1e9-46da-9ffe-81498b6730a0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:14.662592 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6a1767fd-d1e9-46da-9ffe-81498b6730a0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:14.664361 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6a1767fd-d1e9-46da-9ffe-81498b6730a0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:14.665265 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6a1767fd-d1e9-46da-9ffe-81498b6730a0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:14.666238 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6a1767fd-d1e9-46da-9ffe-81498b6730a0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:14.667077 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6a1767fd-d1e9-46da-9ffe-81498b6730a0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:14.667735 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6a1767fd-d1e9-46da-9ffe-81498b6730a0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:14.689284 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-dce4a6e6-ad64-4215-b2ad-8df33e0ef4d4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.141087 Aug 31 09:50:14.697159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 151/316] 10.222.0.13 () {58 vars in 1275 bytes} [Wed Aug 31 09:50:14 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:50:14.894322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-05b76765-b156-4c1d-aa80-26cfa8f67ead tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:14.895041 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-05b76765-b156-4c1d-aa80-26cfa8f67ead tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:14.903201 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-05b76765-b156-4c1d-aa80-26cfa8f67ead tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:14.903936 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-05b76765-b156-4c1d-aa80-26cfa8f67ead tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:14.904512 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-05b76765-b156-4c1d-aa80-26cfa8f67ead tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:14.905410 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-05b76765-b156-4c1d-aa80-26cfa8f67ead tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:14.906069 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-05b76765-b156-4c1d-aa80-26cfa8f67ead tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:14.906485 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-05b76765-b156-4c1d-aa80-26cfa8f67ead tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:15.072825 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-6a1767fd-d1e9-46da-9ffe-81498b6730a0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:15.084455 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-6a1767fd-d1e9-46da-9ffe-81498b6730a0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.437778 Aug 31 09:50:15.085881 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 166/317] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:14 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:15.233631 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-05b76765-b156-4c1d-aa80-26cfa8f67ead tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:15.250303 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-05b76765-b156-4c1d-aa80-26cfa8f67ead tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1505 microversion: 2.1 time: 0.361860 Aug 31 09:50:15.251269 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 152/318] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:14 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1505 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:16.114111 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-00b407fc-8fd8-4b1a-aed1-4243ac4d27a9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:16.114691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-00b407fc-8fd8-4b1a-aed1-4243ac4d27a9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:16.121202 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-00b407fc-8fd8-4b1a-aed1-4243ac4d27a9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:16.121723 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-00b407fc-8fd8-4b1a-aed1-4243ac4d27a9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:16.122149 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-00b407fc-8fd8-4b1a-aed1-4243ac4d27a9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:16.122903 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-00b407fc-8fd8-4b1a-aed1-4243ac4d27a9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:16.123275 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-00b407fc-8fd8-4b1a-aed1-4243ac4d27a9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:16.123681 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-00b407fc-8fd8-4b1a-aed1-4243ac4d27a9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:16.272158 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-67433171-0cc7-48fe-a56b-0af598c9938b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:16.273022 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-67433171-0cc7-48fe-a56b-0af598c9938b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:16.280486 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-67433171-0cc7-48fe-a56b-0af598c9938b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:16.281546 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-67433171-0cc7-48fe-a56b-0af598c9938b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:16.281975 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-67433171-0cc7-48fe-a56b-0af598c9938b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:16.282697 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-67433171-0cc7-48fe-a56b-0af598c9938b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:16.283154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-67433171-0cc7-48fe-a56b-0af598c9938b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:16.283578 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-67433171-0cc7-48fe-a56b-0af598c9938b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:16.303469 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=100 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:16.351778 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-00b407fc-8fd8-4b1a-aed1-4243ac4d27a9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:16.363554 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-00b407fc-8fd8-4b1a-aed1-4243ac4d27a9 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.254056 Aug 31 09:50:16.364242 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 167/319] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:16 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:16.651698 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-67433171-0cc7-48fe-a56b-0af598c9938b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:16.675881 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-67433171-0cc7-48fe-a56b-0af598c9938b tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1505 microversion: 2.1 time: 0.407280 Aug 31 09:50:16.677415 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 153/320] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:16 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1505 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:16.688884 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-2fc297d4-fbfa-4bee-b538-4b6cd0c05e0c req-6687806b-161b-4389-af78-56e79dbc2c4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3", "tag": "cc06604f-efa3-4b8c-a2d5-693ffb365876"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:16.714051 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-2fc297d4-fbfa-4bee-b538-4b6cd0c05e0c req-6687806b-161b-4389-af78-56e79dbc2c4b service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:16.714723 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-2fc297d4-fbfa-4bee-b538-4b6cd0c05e0c req-6687806b-161b-4389-af78-56e79dbc2c4b service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:16.715173 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-2fc297d4-fbfa-4bee-b538-4b6cd0c05e0c req-6687806b-161b-4389-af78-56e79dbc2c4b service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:16.729631 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-2fc297d4-fbfa-4bee-b538-4b6cd0c05e0c req-6687806b-161b-4389-af78-56e79dbc2c4b service nova] Creating event network-changed:cc06604f-efa3-4b8c-a2d5-693ffb365876 for instance cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 on hv-cinder-84496 Aug 31 09:50:16.746640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-2fc297d4-fbfa-4bee-b538-4b6cd0c05e0c req-6687806b-161b-4389-af78-56e79dbc2c4b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064796 Aug 31 09:50:16.747860 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 168/321] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:50:17.390388 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-2a07c8fa-7bab-4943-ac2c-87d2483f4831 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:17.391214 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-2a07c8fa-7bab-4943-ac2c-87d2483f4831 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:17.403305 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2a07c8fa-7bab-4943-ac2c-87d2483f4831 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:17.403816 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2a07c8fa-7bab-4943-ac2c-87d2483f4831 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:17.404261 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2a07c8fa-7bab-4943-ac2c-87d2483f4831 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:17.404990 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2a07c8fa-7bab-4943-ac2c-87d2483f4831 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:17.405617 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2a07c8fa-7bab-4943-ac2c-87d2483f4831 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:17.406004 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2a07c8fa-7bab-4943-ac2c-87d2483f4831 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:17.657723 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2a07c8fa-7bab-4943-ac2c-87d2483f4831 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:17.667996 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-2a07c8fa-7bab-4943-ac2c-87d2483f4831 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.281930 Aug 31 09:50:17.683998 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 154/322] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:17 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:17.732160 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a26660d3-fcd8-48ea-819e-5d37b1864dbd tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:17.740904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-a26660d3-fcd8-48ea-819e-5d37b1864dbd tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:17.757317 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a26660d3-fcd8-48ea-819e-5d37b1864dbd tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:17.757987 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a26660d3-fcd8-48ea-819e-5d37b1864dbd tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:17.758532 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a26660d3-fcd8-48ea-819e-5d37b1864dbd tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:17.759350 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a26660d3-fcd8-48ea-819e-5d37b1864dbd tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:17.759880 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a26660d3-fcd8-48ea-819e-5d37b1864dbd tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:17.760373 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a26660d3-fcd8-48ea-819e-5d37b1864dbd tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:17.800284 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a26660d3-fcd8-48ea-819e-5d37b1864dbd tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:17.800947 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a26660d3-fcd8-48ea-819e-5d37b1864dbd tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:17.801576 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a26660d3-fcd8-48ea-819e-5d37b1864dbd tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:17.802828 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.objects.instance [None req-a26660d3-fcd8-48ea-819e-5d37b1864dbd tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lazy-loading 'fault' on Instance uuid 74d01e00-bf25-4a74-b61e-b1503ad18c47 {{(pid=127170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:50:17.864241 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-a26660d3-fcd8-48ea-819e-5d37b1864dbd tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c475984de9e84ff18fb96c588a07c80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7d52f95e5e452ca2ac11900fc0d931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:17.873495 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a26660d3-fcd8-48ea-819e-5d37b1864dbd tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 200 len: 1304 microversion: 2.1 time: 0.168619 Aug 31 09:50:17.874116 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 169/323] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:17 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 1304 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:18.692754 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-44181bb8-dd7d-404e-9ccd-f3bae04aa172 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:18.694793 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-44181bb8-dd7d-404e-9ccd-f3bae04aa172 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:18.700228 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-44181bb8-dd7d-404e-9ccd-f3bae04aa172 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:18.700994 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-44181bb8-dd7d-404e-9ccd-f3bae04aa172 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:18.701740 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-44181bb8-dd7d-404e-9ccd-f3bae04aa172 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:18.702486 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-44181bb8-dd7d-404e-9ccd-f3bae04aa172 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:18.702971 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-44181bb8-dd7d-404e-9ccd-f3bae04aa172 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:18.703749 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-44181bb8-dd7d-404e-9ccd-f3bae04aa172 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:18.804364 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-a5f44483-632f-4a24-a450-c218bb97a8e7 req-229623ce-4d34-40be-a265-11ad22ad69d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74d01e00-bf25-4a74-b61e-b1503ad18c47", "name": "network-vif-deleted", "tag": "cce2dbff-e77e-4c34-a575-46099f83471f"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:18.823709 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-a5f44483-632f-4a24-a450-c218bb97a8e7 req-229623ce-4d34-40be-a265-11ad22ad69d0 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:18.824189 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-a5f44483-632f-4a24-a450-c218bb97a8e7 req-229623ce-4d34-40be-a265-11ad22ad69d0 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:18.824874 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-a5f44483-632f-4a24-a450-c218bb97a8e7 req-229623ce-4d34-40be-a265-11ad22ad69d0 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:18.843917 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-a5f44483-632f-4a24-a450-c218bb97a8e7 req-229623ce-4d34-40be-a265-11ad22ad69d0 service nova] Creating event network-vif-deleted:cce2dbff-e77e-4c34-a575-46099f83471f for instance 74d01e00-bf25-4a74-b61e-b1503ad18c47 on hv-cinder-84496 Aug 31 09:50:18.856146 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-a5f44483-632f-4a24-a450-c218bb97a8e7 req-229623ce-4d34-40be-a265-11ad22ad69d0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060135 Aug 31 09:50:18.857054 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 170/324] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:50:18.889662 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-44181bb8-dd7d-404e-9ccd-f3bae04aa172 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:18.896774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-86b805f6-3670-47ef-82af-2614195b3508 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:18.897510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-86b805f6-3670-47ef-82af-2614195b3508 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] [instance: 74d01e00-bf25-4a74-b61e-b1503ad18c47] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:18.899327 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-44181bb8-dd7d-404e-9ccd-f3bae04aa172 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.210501 Aug 31 09:50:18.899858 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 155/325] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:18 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:18.904448 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-86b805f6-3670-47ef-82af-2614195b3508 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:18.905026 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-86b805f6-3670-47ef-82af-2614195b3508 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:18.905559 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-86b805f6-3670-47ef-82af-2614195b3508 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:18.906920 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-86b805f6-3670-47ef-82af-2614195b3508 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:18.907437 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-86b805f6-3670-47ef-82af-2614195b3508 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:18.907929 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-86b805f6-3670-47ef-82af-2614195b3508 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:18.926576 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-86b805f6-3670-47ef-82af-2614195b3508 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] HTTP exception thrown: Instance 74d01e00-bf25-4a74-b61e-b1503ad18c47 could not be found. Aug 31 09:50:18.928424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-86b805f6-3670-47ef-82af-2614195b3508 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Request method failure captured: Aug 31 09:50:18.928424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 HTTP/1.1 Aug 31 09:50:18.928424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 09:50:18.928424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 09:50:18.928424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 09:50:18.928424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 09:50:18.928424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 09:50:18.928424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 09:50:18.928424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 09:50:18.928424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 09:50:18.928424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy5-Ti3iNCUi4f5Nq14mKNGMilPkU2PoerTQvpVOp8jCeaDMWajEGEfqRyX7vUT8WGQklWx0VNMSLBa4ZDJIK_PIeohCkvoSfJI-KR05mbpaYjWxZZuAXX2QvYcTgsvaVAgdg_E8ArKQFJOvV8QrMxN-zDfZFtm73zwskwDMUK7LedE Aug 31 09:50:18.928424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 09:50:18.928424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 09:50:18.928424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 09:50:18.928424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 09:50:18.928424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 09:50:18.928424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 09:50:18.928424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: 0d7d52f95e5e452ca2ac11900fc0d931 Aug 31 09:50:18.928424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-VolumesActionsTest-1540542713 Aug 31 09:50:18.928424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 09:50:18.928424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 09:50:18.929937 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0d7d52f95e5e452ca2ac11900fc0d931"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0d7d52f95e5e452ca2ac11900fc0d931"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0d7d52f95e5e452ca2ac11900fc0d931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0d7d52f95e5e452ca2ac11900fc0d931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:50:18.929937 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-VolumesActionsTest-1540542713 Aug 31 09:50:18.929937 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: 0d7d52f95e5e452ca2ac11900fc0d931 Aug 31 09:50:18.929937 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-VolumesActionsTest-1540542713 Aug 31 09:50:18.929937 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-VolumesActionsTest-1540542713-project Aug 31 09:50:18.929937 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 09:50:18.929937 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 09:50:18.929937 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: c475984de9e84ff18fb96c588a07c80b Aug 31 09:50:18.929937 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-VolumesActionsTest-1540542713-project Aug 31 09:50:18.929937 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 09:50:18.929937 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Instance 74d01e00-bf25-4a74-b61e-b1503ad18c47 could not be found. Aug 31 09:50:18.929937 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': '74d01e00-bf25-4a74-b61e-b1503ad18c47'} Aug 31 09:50:18.930785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:50:18.930785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:50:18.930785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:50:18.930785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:50:18.930785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:50:18.930785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:50:18.930785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:50:18.930785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:50:18.930785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:50:18.930785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:50:18.930785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74d01e00-bf25-4a74-b61e-b1503ad18c47 could not be found. Aug 31 09:50:18.930785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:50:18.930785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:50:18.930785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:50:18.930785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:50:18.930785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:50:18.930785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:50:18.930785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:50:18.930785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:50:18.930785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:50:18.932273 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:50:18.932273 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:50:18.932273 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:50:18.932273 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:50:18.932273 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:50:18.932273 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:50:18.932273 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:50:18.932273 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74d01e00-bf25-4a74-b61e-b1503ad18c47 could not be found. Aug 31 09:50:18.932273 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:50:18.932273 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:50:18.932273 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:50:18.932273 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:50:18.932273 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:50:18.932273 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:50:18.932273 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:50:18.932273 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:50:18.932273 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74d01e00-bf25-4a74-b61e-b1503ad18c47 could not be found. Aug 31 09:50:18.932273 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:50:18.933566 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-86b805f6-3670-47ef-82af-2614195b3508 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] Returning 404 to user: Instance 74d01e00-bf25-4a74-b61e-b1503ad18c47 could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:50:18.933651 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-86b805f6-3670-47ef-82af-2614195b3508 tempest-VolumesActionsTest-1540542713 tempest-VolumesActionsTest-1540542713-project] 10.222.0.13 "GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47" status: 404 len: 111 microversion: 2.1 time: 0.040181 Aug 31 09:50:18.934471 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 171/326] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:18 2022] GET /compute/v2.1/servers/74d01e00-bf25-4a74-b61e-b1503ad18c47 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:50:19.920582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-be162fd7-e9cc-4747-9a05-c5b7ff22b87d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:19.921138 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-be162fd7-e9cc-4747-9a05-c5b7ff22b87d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:19.928382 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be162fd7-e9cc-4747-9a05-c5b7ff22b87d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:19.928867 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be162fd7-e9cc-4747-9a05-c5b7ff22b87d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:19.929333 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be162fd7-e9cc-4747-9a05-c5b7ff22b87d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:19.930046 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be162fd7-e9cc-4747-9a05-c5b7ff22b87d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:19.930495 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be162fd7-e9cc-4747-9a05-c5b7ff22b87d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:19.930945 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be162fd7-e9cc-4747-9a05-c5b7ff22b87d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:20.070223 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-be162fd7-e9cc-4747-9a05-c5b7ff22b87d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:20.078928 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-be162fd7-e9cc-4747-9a05-c5b7ff22b87d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.162178 Aug 31 09:50:20.079519 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 156/327] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:19 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:21.102762 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-8de37408-dbe8-4e2a-9f81-b126703433f8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:21.103426 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-8de37408-dbe8-4e2a-9f81-b126703433f8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:21.110832 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8de37408-dbe8-4e2a-9f81-b126703433f8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:21.111394 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8de37408-dbe8-4e2a-9f81-b126703433f8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:21.111857 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8de37408-dbe8-4e2a-9f81-b126703433f8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:21.112633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8de37408-dbe8-4e2a-9f81-b126703433f8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:21.113191 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8de37408-dbe8-4e2a-9f81-b126703433f8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:21.113680 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8de37408-dbe8-4e2a-9f81-b126703433f8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:21.299602 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-8de37408-dbe8-4e2a-9f81-b126703433f8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:21.302264 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:21.310963 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-8de37408-dbe8-4e2a-9f81-b126703433f8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.212440 Aug 31 09:50:21.311545 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 172/328] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:21 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:22.333579 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-015f89c8-9b4d-4ffb-99f4-f9af3d8c622a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:22.334655 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-015f89c8-9b4d-4ffb-99f4-f9af3d8c622a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:22.341293 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-015f89c8-9b4d-4ffb-99f4-f9af3d8c622a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:22.341811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-015f89c8-9b4d-4ffb-99f4-f9af3d8c622a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:22.342241 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-015f89c8-9b4d-4ffb-99f4-f9af3d8c622a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:22.342940 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-015f89c8-9b4d-4ffb-99f4-f9af3d8c622a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:22.343437 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-015f89c8-9b4d-4ffb-99f4-f9af3d8c622a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:22.344069 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-015f89c8-9b4d-4ffb-99f4-f9af3d8c622a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:22.504590 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-015f89c8-9b4d-4ffb-99f4-f9af3d8c622a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:22.512880 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-015f89c8-9b4d-4ffb-99f4-f9af3d8c622a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.183727 Aug 31 09:50:22.513554 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 157/329] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:22 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:23.536153 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-bfb9a652-e9a8-44ed-a2fe-9dfb9d800a09 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:23.536715 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-bfb9a652-e9a8-44ed-a2fe-9dfb9d800a09 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:23.543980 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bfb9a652-e9a8-44ed-a2fe-9dfb9d800a09 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:23.544795 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bfb9a652-e9a8-44ed-a2fe-9dfb9d800a09 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:23.545692 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bfb9a652-e9a8-44ed-a2fe-9dfb9d800a09 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:23.547474 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bfb9a652-e9a8-44ed-a2fe-9dfb9d800a09 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:23.548303 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bfb9a652-e9a8-44ed-a2fe-9dfb9d800a09 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:23.549072 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bfb9a652-e9a8-44ed-a2fe-9dfb9d800a09 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:23.734603 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-bfb9a652-e9a8-44ed-a2fe-9dfb9d800a09 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:23.743371 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-bfb9a652-e9a8-44ed-a2fe-9dfb9d800a09 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.211601 Aug 31 09:50:23.743975 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 173/330] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:23 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:24.766785 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-23391f2a-5807-4faf-b81e-e95b0e71aaf1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:24.767551 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-23391f2a-5807-4faf-b81e-e95b0e71aaf1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:24.776046 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-23391f2a-5807-4faf-b81e-e95b0e71aaf1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:24.776881 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-23391f2a-5807-4faf-b81e-e95b0e71aaf1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:24.777667 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-23391f2a-5807-4faf-b81e-e95b0e71aaf1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:24.778883 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-23391f2a-5807-4faf-b81e-e95b0e71aaf1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:24.779717 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-23391f2a-5807-4faf-b81e-e95b0e71aaf1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:24.780446 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-23391f2a-5807-4faf-b81e-e95b0e71aaf1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:24.935213 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-23391f2a-5807-4faf-b81e-e95b0e71aaf1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:24.943682 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-23391f2a-5807-4faf-b81e-e95b0e71aaf1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.181440 Aug 31 09:50:24.944464 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 158/331] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:24 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:25.966160 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-9c753dc2-2805-495a-a855-3f626f8a112e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:25.966765 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-9c753dc2-2805-495a-a855-3f626f8a112e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:25.973371 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9c753dc2-2805-495a-a855-3f626f8a112e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:25.973869 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9c753dc2-2805-495a-a855-3f626f8a112e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:25.974173 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9c753dc2-2805-495a-a855-3f626f8a112e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:25.974900 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9c753dc2-2805-495a-a855-3f626f8a112e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:25.975335 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9c753dc2-2805-495a-a855-3f626f8a112e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:25.975748 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9c753dc2-2805-495a-a855-3f626f8a112e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:26.127641 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-9c753dc2-2805-495a-a855-3f626f8a112e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:26.135812 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-9c753dc2-2805-495a-a855-3f626f8a112e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.173368 Aug 31 09:50:26.136391 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 174/332] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:25 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:27.158313 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-8b41a538-0cc0-4af4-88cb-0d4fe17f089e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:27.159124 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-8b41a538-0cc0-4af4-88cb-0d4fe17f089e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:27.166931 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8b41a538-0cc0-4af4-88cb-0d4fe17f089e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:27.167414 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8b41a538-0cc0-4af4-88cb-0d4fe17f089e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:27.167842 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8b41a538-0cc0-4af4-88cb-0d4fe17f089e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:27.168548 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8b41a538-0cc0-4af4-88cb-0d4fe17f089e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:27.168999 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8b41a538-0cc0-4af4-88cb-0d4fe17f089e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:27.169446 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8b41a538-0cc0-4af4-88cb-0d4fe17f089e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:27.336584 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-8b41a538-0cc0-4af4-88cb-0d4fe17f089e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:27.349255 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-8b41a538-0cc0-4af4-88cb-0d4fe17f089e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.195067 Aug 31 09:50:27.349978 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 159/333] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:27 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:28.371863 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-10f5ce24-1244-48dd-b188-678111b0a03e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:28.372480 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-10f5ce24-1244-48dd-b188-678111b0a03e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:28.378877 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-10f5ce24-1244-48dd-b188-678111b0a03e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:28.379354 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-10f5ce24-1244-48dd-b188-678111b0a03e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:28.379775 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-10f5ce24-1244-48dd-b188-678111b0a03e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:28.380474 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-10f5ce24-1244-48dd-b188-678111b0a03e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:28.380916 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-10f5ce24-1244-48dd-b188-678111b0a03e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:28.381334 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-10f5ce24-1244-48dd-b188-678111b0a03e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:28.515081 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-10f5ce24-1244-48dd-b188-678111b0a03e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:28.523903 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-10f5ce24-1244-48dd-b188-678111b0a03e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.156134 Aug 31 09:50:28.524492 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 175/334] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:28 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:29.545898 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-990241d4-43e1-415c-86a1-e60d997cef24 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:29.546526 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-990241d4-43e1-415c-86a1-e60d997cef24 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:29.549492 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=58 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:29.554906 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-990241d4-43e1-415c-86a1-e60d997cef24 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:29.555396 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-990241d4-43e1-415c-86a1-e60d997cef24 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:29.555838 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-990241d4-43e1-415c-86a1-e60d997cef24 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:29.556536 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-990241d4-43e1-415c-86a1-e60d997cef24 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:29.556990 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-990241d4-43e1-415c-86a1-e60d997cef24 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:29.558194 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-990241d4-43e1-415c-86a1-e60d997cef24 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:29.756387 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-990241d4-43e1-415c-86a1-e60d997cef24 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:29.765547 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-990241d4-43e1-415c-86a1-e60d997cef24 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.224474 Aug 31 09:50:29.766340 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 160/335] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:29 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:30.788047 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-e3418163-59d1-47e1-8c06-37f1b9f0ad27 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:30.788994 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-e3418163-59d1-47e1-8c06-37f1b9f0ad27 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:30.794526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:30.796777 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e3418163-59d1-47e1-8c06-37f1b9f0ad27 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:30.797309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e3418163-59d1-47e1-8c06-37f1b9f0ad27 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:30.797866 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e3418163-59d1-47e1-8c06-37f1b9f0ad27 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:30.798835 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e3418163-59d1-47e1-8c06-37f1b9f0ad27 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:30.799292 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e3418163-59d1-47e1-8c06-37f1b9f0ad27 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:30.799720 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e3418163-59d1-47e1-8c06-37f1b9f0ad27 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:30.947167 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-e3418163-59d1-47e1-8c06-37f1b9f0ad27 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:30.956880 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-e3418163-59d1-47e1-8c06-37f1b9f0ad27 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.174021 Aug 31 09:50:30.957576 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 176/336] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:30 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:31.978771 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-fb4d0c89-389f-4172-9d48-0427f9e64606 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:31.979383 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-fb4d0c89-389f-4172-9d48-0427f9e64606 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:31.986399 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fb4d0c89-389f-4172-9d48-0427f9e64606 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:31.986888 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fb4d0c89-389f-4172-9d48-0427f9e64606 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:31.987320 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fb4d0c89-389f-4172-9d48-0427f9e64606 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:31.988030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fb4d0c89-389f-4172-9d48-0427f9e64606 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:31.988477 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fb4d0c89-389f-4172-9d48-0427f9e64606 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:31.988894 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fb4d0c89-389f-4172-9d48-0427f9e64606 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:32.130259 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-fb4d0c89-389f-4172-9d48-0427f9e64606 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:32.138164 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-fb4d0c89-389f-4172-9d48-0427f9e64606 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.163276 Aug 31 09:50:32.138749 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 161/337] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:31 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:33.160770 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f957c2ce-e5ed-4cde-8712-85e7e75a7193 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:33.161307 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-f957c2ce-e5ed-4cde-8712-85e7e75a7193 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:33.167329 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f957c2ce-e5ed-4cde-8712-85e7e75a7193 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:33.167807 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f957c2ce-e5ed-4cde-8712-85e7e75a7193 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:33.168236 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f957c2ce-e5ed-4cde-8712-85e7e75a7193 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:33.168918 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f957c2ce-e5ed-4cde-8712-85e7e75a7193 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:33.169363 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f957c2ce-e5ed-4cde-8712-85e7e75a7193 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:33.169807 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f957c2ce-e5ed-4cde-8712-85e7e75a7193 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:33.469764 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-f957c2ce-e5ed-4cde-8712-85e7e75a7193 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:33.478271 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-f957c2ce-e5ed-4cde-8712-85e7e75a7193 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.322363 Aug 31 09:50:33.478872 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 177/338] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:33 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:34.499915 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-877fabeb-0b54-46db-a77b-d6e5724872c2 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:34.500529 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-877fabeb-0b54-46db-a77b-d6e5724872c2 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:34.507970 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-877fabeb-0b54-46db-a77b-d6e5724872c2 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:34.508489 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-877fabeb-0b54-46db-a77b-d6e5724872c2 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:34.508929 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-877fabeb-0b54-46db-a77b-d6e5724872c2 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:34.509672 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-877fabeb-0b54-46db-a77b-d6e5724872c2 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:34.510124 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-877fabeb-0b54-46db-a77b-d6e5724872c2 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:34.510548 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-877fabeb-0b54-46db-a77b-d6e5724872c2 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:34.653073 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-877fabeb-0b54-46db-a77b-d6e5724872c2 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:34.666371 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-877fabeb-0b54-46db-a77b-d6e5724872c2 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.170141 Aug 31 09:50:34.667416 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 162/339] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:34 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:35.689197 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-7f3e28eb-85e8-402e-b6bd-54e6409c646c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:35.690253 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-7f3e28eb-85e8-402e-b6bd-54e6409c646c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:35.696903 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7f3e28eb-85e8-402e-b6bd-54e6409c646c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:35.697498 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7f3e28eb-85e8-402e-b6bd-54e6409c646c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:35.698040 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7f3e28eb-85e8-402e-b6bd-54e6409c646c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:35.698733 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7f3e28eb-85e8-402e-b6bd-54e6409c646c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:35.699174 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7f3e28eb-85e8-402e-b6bd-54e6409c646c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:35.699586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7f3e28eb-85e8-402e-b6bd-54e6409c646c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:35.873108 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-7f3e28eb-85e8-402e-b6bd-54e6409c646c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:35.882572 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-7f3e28eb-85e8-402e-b6bd-54e6409c646c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.197789 Aug 31 09:50:35.883159 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 178/340] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:35 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:36.904580 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c472e0ce-75e4-4967-a8fb-135dc8bae545 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:36.905484 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c472e0ce-75e4-4967-a8fb-135dc8bae545 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:36.912448 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c472e0ce-75e4-4967-a8fb-135dc8bae545 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:36.913134 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c472e0ce-75e4-4967-a8fb-135dc8bae545 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:36.913607 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c472e0ce-75e4-4967-a8fb-135dc8bae545 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:36.914316 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c472e0ce-75e4-4967-a8fb-135dc8bae545 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:36.914764 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c472e0ce-75e4-4967-a8fb-135dc8bae545 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:36.915187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c472e0ce-75e4-4967-a8fb-135dc8bae545 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:37.078353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c472e0ce-75e4-4967-a8fb-135dc8bae545 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:37.087015 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c472e0ce-75e4-4967-a8fb-135dc8bae545 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.186315 Aug 31 09:50:37.087630 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 163/341] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:36 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:38.115692 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-0fd70f63-340e-4cbd-bda4-4d836b256f45 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:38.116617 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-0fd70f63-340e-4cbd-bda4-4d836b256f45 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:38.123694 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0fd70f63-340e-4cbd-bda4-4d836b256f45 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:38.125010 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0fd70f63-340e-4cbd-bda4-4d836b256f45 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:38.127714 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0fd70f63-340e-4cbd-bda4-4d836b256f45 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:38.128908 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0fd70f63-340e-4cbd-bda4-4d836b256f45 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:38.129670 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0fd70f63-340e-4cbd-bda4-4d836b256f45 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:38.130590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0fd70f63-340e-4cbd-bda4-4d836b256f45 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:38.346782 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-0fd70f63-340e-4cbd-bda4-4d836b256f45 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:38.366963 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-0fd70f63-340e-4cbd-bda4-4d836b256f45 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.257196 Aug 31 09:50:38.368312 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 179/342] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:38 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:39.391186 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-0e93b468-a697-42ec-bae0-d39a67189fd0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:39.392670 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-0e93b468-a697-42ec-bae0-d39a67189fd0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:39.400345 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0e93b468-a697-42ec-bae0-d39a67189fd0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:39.400671 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0e93b468-a697-42ec-bae0-d39a67189fd0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:39.401111 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0e93b468-a697-42ec-bae0-d39a67189fd0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:39.401867 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0e93b468-a697-42ec-bae0-d39a67189fd0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:39.402322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0e93b468-a697-42ec-bae0-d39a67189fd0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:39.402826 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0e93b468-a697-42ec-bae0-d39a67189fd0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:39.573361 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-0e93b468-a697-42ec-bae0-d39a67189fd0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:39.582750 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-0e93b468-a697-42ec-bae0-d39a67189fd0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.195470 Aug 31 09:50:39.583416 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 164/343] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:39 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:40.630143 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-9fe55741-1d75-484d-ad9a-b87d584f7cc0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:40.631741 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-9fe55741-1d75-484d-ad9a-b87d584f7cc0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:40.640222 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9fe55741-1d75-484d-ad9a-b87d584f7cc0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:40.641153 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9fe55741-1d75-484d-ad9a-b87d584f7cc0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:40.642445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9fe55741-1d75-484d-ad9a-b87d584f7cc0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:40.643967 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9fe55741-1d75-484d-ad9a-b87d584f7cc0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:40.644761 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9fe55741-1d75-484d-ad9a-b87d584f7cc0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:40.646331 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9fe55741-1d75-484d-ad9a-b87d584f7cc0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:40.863698 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-9fe55741-1d75-484d-ad9a-b87d584f7cc0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:40.874511 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-9fe55741-1d75-484d-ad9a-b87d584f7cc0 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.265117 Aug 31 09:50:40.888921 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 180/344] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:40 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:41.900117 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-5ce3a29f-8538-4514-a64e-5301ca5f5967 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:41.901435 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-5ce3a29f-8538-4514-a64e-5301ca5f5967 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:41.912442 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5ce3a29f-8538-4514-a64e-5301ca5f5967 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:41.913114 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5ce3a29f-8538-4514-a64e-5301ca5f5967 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:41.913960 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5ce3a29f-8538-4514-a64e-5301ca5f5967 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:41.914800 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5ce3a29f-8538-4514-a64e-5301ca5f5967 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:41.930786 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5ce3a29f-8538-4514-a64e-5301ca5f5967 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:41.931287 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5ce3a29f-8538-4514-a64e-5301ca5f5967 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:42.144696 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-5ce3a29f-8538-4514-a64e-5301ca5f5967 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:42.155285 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-5ce3a29f-8538-4514-a64e-5301ca5f5967 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.260598 Aug 31 09:50:42.156007 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 165/345] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:41 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:43.183058 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b4e952d5-9262-4ec4-9fc9-b24334e46e04 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:43.184835 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b4e952d5-9262-4ec4-9fc9-b24334e46e04 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:43.194213 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b4e952d5-9262-4ec4-9fc9-b24334e46e04 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:43.195590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b4e952d5-9262-4ec4-9fc9-b24334e46e04 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:43.197212 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b4e952d5-9262-4ec4-9fc9-b24334e46e04 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:43.198352 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b4e952d5-9262-4ec4-9fc9-b24334e46e04 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:43.199673 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b4e952d5-9262-4ec4-9fc9-b24334e46e04 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:43.200336 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b4e952d5-9262-4ec4-9fc9-b24334e46e04 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:43.506075 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b4e952d5-9262-4ec4-9fc9-b24334e46e04 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:43.521346 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b4e952d5-9262-4ec4-9fc9-b24334e46e04 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.344512 Aug 31 09:50:43.524117 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 181/346] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:43 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:44.569273 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-61efd406-dd97-4086-9d07-473821110f48 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:44.579163 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-61efd406-dd97-4086-9d07-473821110f48 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:44.627247 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-61efd406-dd97-4086-9d07-473821110f48 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:44.629315 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-61efd406-dd97-4086-9d07-473821110f48 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:44.630544 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-61efd406-dd97-4086-9d07-473821110f48 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:44.632114 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-61efd406-dd97-4086-9d07-473821110f48 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:44.633049 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-61efd406-dd97-4086-9d07-473821110f48 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:44.634010 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-61efd406-dd97-4086-9d07-473821110f48 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:45.083140 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-61efd406-dd97-4086-9d07-473821110f48 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:45.095776 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-61efd406-dd97-4086-9d07-473821110f48 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.552212 Aug 31 09:50:45.097676 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 166/347] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:44 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:46.120774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-66aab663-96a6-48ff-a0f9-f95aa5e3b3e8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:46.121929 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-66aab663-96a6-48ff-a0f9-f95aa5e3b3e8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:46.138823 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-66aab663-96a6-48ff-a0f9-f95aa5e3b3e8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:46.145085 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-66aab663-96a6-48ff-a0f9-f95aa5e3b3e8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:46.148618 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-66aab663-96a6-48ff-a0f9-f95aa5e3b3e8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:46.153890 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-66aab663-96a6-48ff-a0f9-f95aa5e3b3e8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:46.154380 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-66aab663-96a6-48ff-a0f9-f95aa5e3b3e8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:46.154821 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-66aab663-96a6-48ff-a0f9-f95aa5e3b3e8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:46.370126 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-66aab663-96a6-48ff-a0f9-f95aa5e3b3e8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:46.383056 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-66aab663-96a6-48ff-a0f9-f95aa5e3b3e8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1503 microversion: 2.1 time: 0.268538 Aug 31 09:50:46.383937 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 182/348] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:46 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1503 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:46.410089 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c2c3f04a-54da-4cd5-8135-883242060207 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81f135fd-ccec-4d57-89be-e590b06b1f14"}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:46.413569 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c2c3f04a-54da-4cd5-8135-883242060207 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:46.422712 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c2c3f04a-54da-4cd5-8135-883242060207 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:46.423708 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c2c3f04a-54da-4cd5-8135-883242060207 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:46.425033 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c2c3f04a-54da-4cd5-8135-883242060207 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:46.426664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c2c3f04a-54da-4cd5-8135-883242060207 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:46.427683 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c2c3f04a-54da-4cd5-8135-883242060207 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:46.428371 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c2c3f04a-54da-4cd5-8135-883242060207 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:46.445774 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=82 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:46.488455 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.wsgi [None req-c2c3f04a-54da-4cd5-8135-883242060207 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] HTTP exception thrown: Cannot 'attach_volume' instance dd0a166f-d662-4a72-8ea2-bfbbb02b2221 while it is in vm_state rescued Aug 31 09:50:46.492384 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c2c3f04a-54da-4cd5-8135-883242060207 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Request method failure captured: Aug 31 09:50:46.492384 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: request: POST /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221/os-volume_attachments HTTP/1.1 Aug 31 09:50:46.492384 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept: application/json Aug 31 09:50:46.492384 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept-Encoding: identity Aug 31 09:50:46.492384 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Connection: close Aug 31 09:50:46.492384 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Length: 74 Aug 31 09:50:46.492384 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Type: application/json Aug 31 09:50:46.492384 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Host: 10.222.0.13 Aug 31 09:50:46.492384 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Openstack-System-Scope: None Aug 31 09:50:46.492384 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: User-Agent: python-urllib3/1.26.12 Aug 31 09:50:46.492384 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Auth-Token: gAAAAABjDy5OTDLNRfLh5I253GwLv23LsAUrNMn0r9xaten2h7_1_5xHwhGyUEaQYYHfDmmHCd0ZNSB8h1zSiuyFLSm9-AvFKxWjgyu8fdEQl6UJfoKqRgJfuqhoDcaQr_FT6z1TSznbTbqj78fmKsXLoDaJbKqpRSnNN2tpZX8CNlgCtAi_Hak Aug 31 09:50:46.492384 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Id: None Aug 31 09:50:46.492384 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Name: None Aug 31 09:50:46.492384 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Identity-Status: Confirmed Aug 31 09:50:46.492384 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Is-Admin-Project: True Aug 31 09:50:46.492384 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Id: default Aug 31 09:50:46.492384 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Name: Default Aug 31 09:50:46.492384 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Id: c0fc6660b5494415915cdf2b325e5bd6 Aug 31 09:50:46.492384 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-742304945 Aug 31 09:50:46.492384 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Role: member,reader Aug 31 09:50:46.492384 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Roles: member,reader Aug 31 09:50:46.493770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c0fc6660b5494415915cdf2b325e5bd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c0fc6660b5494415915cdf2b325e5bd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c0fc6660b5494415915cdf2b325e5bd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c0fc6660b5494415915cdf2b325e5bd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:50:46.493770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant: tempest-ServerRescueNegativeTestJSON-742304945 Aug 31 09:50:46.493770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Id: c0fc6660b5494415915cdf2b325e5bd6 Aug 31 09:50:46.493770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-742304945 Aug 31 09:50:46.493770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User: tempest-ServerRescueNegativeTestJSON-742304945-project Aug 31 09:50:46.493770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Id: default Aug 31 09:50:46.493770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Name: Default Aug 31 09:50:46.493770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Id: 886e40cf192d46c2b2e7eb2a95ec62e1 Aug 31 09:50:46.493770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Name: tempest-ServerRescueNegativeTestJSON-742304945-project Aug 31 09:50:46.493770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Aug 31 09:50:46.493770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: {"volumeAttachment": {"volumeId": "81f135fd-ccec-4d57-89be-e590b06b1f14"}} Aug 31 09:50:46.493770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: method: > Aug 31 09:50:46.494522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: exception: Cannot 'attach_volume' instance dd0a166f-d662-4a72-8ea2-bfbbb02b2221 while it is in vm_state rescued Aug 31 09:50:46.494522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: action_args: {'server_id': 'dd0a166f-d662-4a72-8ea2-bfbbb02b2221', 'body': {'volumeAttachment': {'volumeId': '81f135fd-ccec-4d57-89be-e590b06b1f14'}}} Aug 31 09:50:46.494522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:50:46.494522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:50:46.494522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 09:50:46.494522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 09:50:46.494522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 09:50:46.494522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 09:50:46.494522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 09:50:46.494522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 09:50:46.494522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dd0a166f-d662-4a72-8ea2-bfbbb02b2221 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 31 09:50:46.494522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:50:46.494522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:50:46.494522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:50:46.494522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:50:46.494522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:50:46.494522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:50:46.494522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:50:46.494522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:50:46.495697 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:50:46.495697 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:50:46.495697 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:50:46.495697 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:50:46.495697 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:50:46.495697 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:50:46.495697 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:50:46.495697 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:50:46.495697 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 31 09:50:46.495697 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 09:50:46.495697 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 09:50:46.495697 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 09:50:46.495697 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance dd0a166f-d662-4a72-8ea2-bfbbb02b2221 while it is in vm_state rescued Aug 31 09:50:46.495697 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:50:46.495697 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:50:46.495697 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:50:46.495697 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:50:46.495697 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:50:46.495697 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:50:46.496801 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:50:46.496801 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:50:46.496801 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance dd0a166f-d662-4a72-8ea2-bfbbb02b2221 while it is in vm_state rescued Aug 31 09:50:46.496801 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:50:46.496801 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c2c3f04a-54da-4cd5-8135-883242060207 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Returning 409 to user: Cannot 'attach_volume' instance dd0a166f-d662-4a72-8ea2-bfbbb02b2221 while it is in vm_state rescued {{(pid=127171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:50:46.496801 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c2c3f04a-54da-4cd5-8135-883242060207 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "POST /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.091751 Aug 31 09:50:46.496801 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 167/349] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 31 09:50:46 2022] POST /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221/os-volume_attachments => generated 152 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 09:50:46.508959 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-17d6096e-c591-4ed7-ab2b-bde869b03d20 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:46.509862 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-17d6096e-c591-4ed7-ab2b-bde869b03d20 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:46.519227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-17d6096e-c591-4ed7-ab2b-bde869b03d20 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:46.520226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-17d6096e-c591-4ed7-ab2b-bde869b03d20 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:46.520676 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-17d6096e-c591-4ed7-ab2b-bde869b03d20 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:46.521436 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-17d6096e-c591-4ed7-ab2b-bde869b03d20 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:46.522067 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-17d6096e-c591-4ed7-ab2b-bde869b03d20 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:46.522983 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-17d6096e-c591-4ed7-ab2b-bde869b03d20 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:46.651751 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-17d6096e-c591-4ed7-ab2b-bde869b03d20 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "POST /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221/action" status: 202 len: 0 microversion: 2.1 time: 0.147984 Aug 31 09:50:46.652794 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 183/350] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 31 09:50:46 2022] POST /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:50:46.666089 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-2949a043-e3a6-4d45-9394-377794e15646 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:46.667329 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-2949a043-e3a6-4d45-9394-377794e15646 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:46.688432 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2949a043-e3a6-4d45-9394-377794e15646 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:46.689570 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2949a043-e3a6-4d45-9394-377794e15646 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:46.690242 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2949a043-e3a6-4d45-9394-377794e15646 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:46.691445 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2949a043-e3a6-4d45-9394-377794e15646 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:46.692180 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2949a043-e3a6-4d45-9394-377794e15646 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:46.692820 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2949a043-e3a6-4d45-9394-377794e15646 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:46.948825 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2949a043-e3a6-4d45-9394-377794e15646 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:46.960975 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-2949a043-e3a6-4d45-9394-377794e15646 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1511 microversion: 2.1 time: 0.300560 Aug 31 09:50:46.962025 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 168/351] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:46 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1511 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:47.988922 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-953f6e13-8da4-4756-a0fc-6b7d4e4314df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:47.989832 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-953f6e13-8da4-4756-a0fc-6b7d4e4314df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:48.012612 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-953f6e13-8da4-4756-a0fc-6b7d4e4314df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:48.016257 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-953f6e13-8da4-4756-a0fc-6b7d4e4314df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:48.017200 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-953f6e13-8da4-4756-a0fc-6b7d4e4314df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:48.018648 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-953f6e13-8da4-4756-a0fc-6b7d4e4314df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:48.019324 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-953f6e13-8da4-4756-a0fc-6b7d4e4314df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:48.019831 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-953f6e13-8da4-4756-a0fc-6b7d4e4314df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:48.213254 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-953f6e13-8da4-4756-a0fc-6b7d4e4314df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:48.232900 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-953f6e13-8da4-4756-a0fc-6b7d4e4314df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1511 microversion: 2.1 time: 0.250629 Aug 31 09:50:48.248260 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 184/352] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:47 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1511 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:49.256416 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-a0f6b356-f0a8-4ec9-bfca-f53e1786fc09 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:49.257047 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-a0f6b356-f0a8-4ec9-bfca-f53e1786fc09 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:49.263921 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a0f6b356-f0a8-4ec9-bfca-f53e1786fc09 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:49.264646 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a0f6b356-f0a8-4ec9-bfca-f53e1786fc09 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:49.265262 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a0f6b356-f0a8-4ec9-bfca-f53e1786fc09 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:49.266687 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a0f6b356-f0a8-4ec9-bfca-f53e1786fc09 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:49.267663 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a0f6b356-f0a8-4ec9-bfca-f53e1786fc09 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:49.268248 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a0f6b356-f0a8-4ec9-bfca-f53e1786fc09 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:49.496614 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-a0f6b356-f0a8-4ec9-bfca-f53e1786fc09 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:49.507809 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-a0f6b356-f0a8-4ec9-bfca-f53e1786fc09 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1511 microversion: 2.1 time: 0.255260 Aug 31 09:50:49.521869 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 169/353] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:49 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1511 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:50.530497 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-e1697d32-4a6f-4e53-b88d-fc1b4850a254 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:50.531582 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-e1697d32-4a6f-4e53-b88d-fc1b4850a254 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:50.542291 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e1697d32-4a6f-4e53-b88d-fc1b4850a254 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:50.543569 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e1697d32-4a6f-4e53-b88d-fc1b4850a254 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:50.544755 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e1697d32-4a6f-4e53-b88d-fc1b4850a254 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:50.546604 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e1697d32-4a6f-4e53-b88d-fc1b4850a254 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:50.549151 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e1697d32-4a6f-4e53-b88d-fc1b4850a254 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:50.550299 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e1697d32-4a6f-4e53-b88d-fc1b4850a254 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:50.948100 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-e1697d32-4a6f-4e53-b88d-fc1b4850a254 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:50.992646 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-e1697d32-4a6f-4e53-b88d-fc1b4850a254 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1511 microversion: 2.1 time: 0.466404 Aug 31 09:50:51.000032 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 185/354] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:50 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1511 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:52.027994 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-b3c17e9d-217e-49eb-9f74-d44327be76ff tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:52.030751 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-b3c17e9d-217e-49eb-9f74-d44327be76ff tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:52.045610 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b3c17e9d-217e-49eb-9f74-d44327be76ff tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:52.047041 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b3c17e9d-217e-49eb-9f74-d44327be76ff tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:52.049246 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b3c17e9d-217e-49eb-9f74-d44327be76ff tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:52.050633 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b3c17e9d-217e-49eb-9f74-d44327be76ff tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:52.051819 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b3c17e9d-217e-49eb-9f74-d44327be76ff tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:52.052986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b3c17e9d-217e-49eb-9f74-d44327be76ff tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:52.255843 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b3c17e9d-217e-49eb-9f74-d44327be76ff tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:52.271576 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-b3c17e9d-217e-49eb-9f74-d44327be76ff tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1517 microversion: 2.1 time: 0.247361 Aug 31 09:50:52.289257 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 170/355] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:52 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1517 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:54.057958 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-8c4e14ec-4953-4c4e-8f2f-0c9adc951f8e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Action: 'create', calling method: .version_select at 0x7f5503f49ee0>, body: {"keypair": {"name": "tempest-keypair-338542473", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8+OWvZ24gjqU2InvQZ9mQ2/c0WclxaGizhoLjOBbk5fM1jBt+AtQr82oAR0uFwkd26BPhlM/iyP4pTxiXMKF5VC+A+Fcpq+MjS6j4/vgvjg7ZSv3MEsfhqhefddUqUfw=="}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:54.142059 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-8c4e14ec-4953-4c4e-8f2f-0c9adc951f8e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Getting quotas for project c0fc6660b5494415915cdf2b325e5bd6. Resources: {'key_pairs'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:50:54.149284 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-8c4e14ec-4953-4c4e-8f2f-0c9adc951f8e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Getting quotas for user 886e40cf192d46c2b2e7eb2a95ec62e1 and project c0fc6660b5494415915cdf2b325e5bd6. Resources: {'key_pairs'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:50:54.219913 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-8c4e14ec-4953-4c4e-8f2f-0c9adc951f8e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.175458 Aug 31 09:50:54.220255 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 186/356] 10.222.0.13 () {60 vars in 1159 bytes} [Wed Aug 31 09:50:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:50:56.929002 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-51a05843-c10d-4d02-b09e-9f9ab040101f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-998568516", "imageRef": "8e078bb9-f274-4984-8128-d31407d49604", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e69cc92-d348-4eef-9a4c-b8daacafc440"}], "security_groups": [{"name": "tempest-securitygroup--1409086732"}], "key_name": "tempest-keypair-338542473", "user_data": "}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:57.162061 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.network.neutron [None req-51a05843-c10d-4d02-b09e-9f9ab040101f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] validate_networks() for [('2e69cc92-d348-4eef-9a4c-b8daacafc440', None, None, None, None, None)] {{(pid=127171) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:50:57.965002 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-51a05843-c10d-4d02-b09e-9f9ab040101f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Flavor limits 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:50:57.966647 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-51a05843-c10d-4d02-b09e-9f9ab040101f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Image limits 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:50:57.967758 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-51a05843-c10d-4d02-b09e-9f9ab040101f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Flavor pref 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:50:57.969907 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-51a05843-c10d-4d02-b09e-9f9ab040101f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Image pref 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:50:57.979351 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-51a05843-c10d-4d02-b09e-9f9ab040101f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:50:57.997940 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-51a05843-c10d-4d02-b09e-9f9ab040101f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:58.000091 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-51a05843-c10d-4d02-b09e-9f9ab040101f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:58.002641 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-51a05843-c10d-4d02-b09e-9f9ab040101f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:58.004145 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-51a05843-c10d-4d02-b09e-9f9ab040101f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:58.005241 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-51a05843-c10d-4d02-b09e-9f9ab040101f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:58.006147 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-51a05843-c10d-4d02-b09e-9f9ab040101f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:58.066756 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-51a05843-c10d-4d02-b09e-9f9ab040101f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Getting quotas for project c0fc6660b5494415915cdf2b325e5bd6. Resources: {'ram', 'instances', 'cores'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:50:58.108735 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-51a05843-c10d-4d02-b09e-9f9ab040101f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Getting quotas for user 886e40cf192d46c2b2e7eb2a95ec62e1 and project c0fc6660b5494415915cdf2b325e5bd6. Resources: {'ram', 'instances', 'cores'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:50:58.173098 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-51a05843-c10d-4d02-b09e-9f9ab040101f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Going to run 1 instances... {{(pid=127171) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:50:58.179707 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-51a05843-c10d-4d02-b09e-9f9ab040101f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8e078bb9-f274-4984-8128-d31407d49604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:50:58.269777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-51a05843-c10d-4d02-b09e-9f9ab040101f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.350128 Aug 31 09:50:58.271247 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 171/357] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 31 09:50:56 2022] POST /compute/v2.1/servers => generated 409 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:50:58.288347 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-7fa7ab48-7560-478a-b194-801671d5c8d1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:58.289716 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-7fa7ab48-7560-478a-b194-801671d5c8d1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:58.398995 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-7fa7ab48-7560-478a-b194-801671d5c8d1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:58.422815 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-7fa7ab48-7560-478a-b194-801671d5c8d1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1244 microversion: 2.1 time: 0.142495 Aug 31 09:50:58.424598 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 187/358] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:58 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1244 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:59.446224 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-38820157-68d1-4b4c-b6be-bf9b3fa5e533 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:59.448441 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-38820157-68d1-4b4c-b6be-bf9b3fa5e533 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:59.462006 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38820157-68d1-4b4c-b6be-bf9b3fa5e533 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:59.463781 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38820157-68d1-4b4c-b6be-bf9b3fa5e533 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:59.464398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38820157-68d1-4b4c-b6be-bf9b3fa5e533 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:59.465631 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38820157-68d1-4b4c-b6be-bf9b3fa5e533 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:59.466211 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38820157-68d1-4b4c-b6be-bf9b3fa5e533 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:59.466731 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38820157-68d1-4b4c-b6be-bf9b3fa5e533 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:59.585168 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-38820157-68d1-4b4c-b6be-bf9b3fa5e533 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:59.594252 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-38820157-68d1-4b4c-b6be-bf9b3fa5e533 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1248 microversion: 2.1 time: 0.153521 Aug 31 09:50:59.603087 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 172/359] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:59 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1248 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:00.638508 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-4809a165-1c35-4145-ae9c-def3f931f3b8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:00.639242 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-4809a165-1c35-4145-ae9c-def3f931f3b8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:00.647269 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4809a165-1c35-4145-ae9c-def3f931f3b8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:00.648088 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4809a165-1c35-4145-ae9c-def3f931f3b8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:00.648599 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4809a165-1c35-4145-ae9c-def3f931f3b8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:00.649307 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4809a165-1c35-4145-ae9c-def3f931f3b8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:00.649944 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4809a165-1c35-4145-ae9c-def3f931f3b8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:00.650540 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4809a165-1c35-4145-ae9c-def3f931f3b8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:00.653875 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:00.744650 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-4809a165-1c35-4145-ae9c-def3f931f3b8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:00.754083 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-4809a165-1c35-4145-ae9c-def3f931f3b8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1248 microversion: 2.1 time: 0.119640 Aug 31 09:51:00.754863 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 188/360] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:00 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1248 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:51:01.784810 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-a95e7779-dbf8-41f8-9259-e252507f0611 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:01.786237 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-a95e7779-dbf8-41f8-9259-e252507f0611 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:01.788759 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:01.794846 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a95e7779-dbf8-41f8-9259-e252507f0611 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:01.795415 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a95e7779-dbf8-41f8-9259-e252507f0611 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:01.795917 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a95e7779-dbf8-41f8-9259-e252507f0611 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:01.797513 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a95e7779-dbf8-41f8-9259-e252507f0611 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:01.798171 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a95e7779-dbf8-41f8-9259-e252507f0611 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:01.798731 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a95e7779-dbf8-41f8-9259-e252507f0611 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:01.890136 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-a95e7779-dbf8-41f8-9259-e252507f0611 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:01.901601 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-a95e7779-dbf8-41f8-9259-e252507f0611 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1248 microversion: 2.1 time: 0.120913 Aug 31 09:51:01.902192 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 173/361] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:01 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1248 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:02.926384 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-ec3a10bc-7993-44fc-8846-ac0f211414fb tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:02.927600 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-ec3a10bc-7993-44fc-8846-ac0f211414fb tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:02.929897 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:02.936898 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ec3a10bc-7993-44fc-8846-ac0f211414fb tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:02.937585 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ec3a10bc-7993-44fc-8846-ac0f211414fb tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:02.938057 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ec3a10bc-7993-44fc-8846-ac0f211414fb tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:02.938802 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ec3a10bc-7993-44fc-8846-ac0f211414fb tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:02.939332 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ec3a10bc-7993-44fc-8846-ac0f211414fb tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:02.939749 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ec3a10bc-7993-44fc-8846-ac0f211414fb tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:03.012886 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-ec3a10bc-7993-44fc-8846-ac0f211414fb tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:03.022956 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-ec3a10bc-7993-44fc-8846-ac0f211414fb tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1240 microversion: 2.1 time: 0.101563 Aug 31 09:51:03.023559 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 189/362] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:02 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1240 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:04.051050 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-f7b4c191-5165-4a90-9d5f-199e410e7591 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:04.052187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-f7b4c191-5165-4a90-9d5f-199e410e7591 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:04.063587 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f7b4c191-5165-4a90-9d5f-199e410e7591 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:04.064269 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f7b4c191-5165-4a90-9d5f-199e410e7591 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:04.064779 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f7b4c191-5165-4a90-9d5f-199e410e7591 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:04.065643 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f7b4c191-5165-4a90-9d5f-199e410e7591 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:04.066219 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f7b4c191-5165-4a90-9d5f-199e410e7591 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:04.066907 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f7b4c191-5165-4a90-9d5f-199e410e7591 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:04.147807 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-f7b4c191-5165-4a90-9d5f-199e410e7591 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:04.165565 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-f7b4c191-5165-4a90-9d5f-199e410e7591 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1296 microversion: 2.1 time: 0.121913 Aug 31 09:51:04.166484 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 174/363] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:04 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1296 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:05.194302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-5f7f7ecb-eabe-4d22-bcd5-10cec1fec9fd tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:05.194302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-5f7f7ecb-eabe-4d22-bcd5-10cec1fec9fd tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:05.210163 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5f7f7ecb-eabe-4d22-bcd5-10cec1fec9fd tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:05.211031 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5f7f7ecb-eabe-4d22-bcd5-10cec1fec9fd tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:05.212295 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5f7f7ecb-eabe-4d22-bcd5-10cec1fec9fd tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:05.213341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5f7f7ecb-eabe-4d22-bcd5-10cec1fec9fd tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:05.214451 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5f7f7ecb-eabe-4d22-bcd5-10cec1fec9fd tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:05.215528 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5f7f7ecb-eabe-4d22-bcd5-10cec1fec9fd tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:05.878806 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-5f7f7ecb-eabe-4d22-bcd5-10cec1fec9fd tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:05.903097 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-5f7f7ecb-eabe-4d22-bcd5-10cec1fec9fd tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1370 microversion: 2.1 time: 0.716859 Aug 31 09:51:05.904898 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 190/364] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:05 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1370 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:06.492269 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-8978b0ea-f2ef-4acf-a8f4-50ef05e9e1f6 req-5f34fd88-b042-434f-9623-b17ad4b4f033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad92550c-f29b-4f97-9511-a2f1ffa98e3e", "tag": "ebfc41b8-372f-4c67-97e3-7caa675975ac"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:06.512444 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-8978b0ea-f2ef-4acf-a8f4-50ef05e9e1f6 req-5f34fd88-b042-434f-9623-b17ad4b4f033 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:06.513081 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-8978b0ea-f2ef-4acf-a8f4-50ef05e9e1f6 req-5f34fd88-b042-434f-9623-b17ad4b4f033 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:06.514031 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-8978b0ea-f2ef-4acf-a8f4-50ef05e9e1f6 req-5f34fd88-b042-434f-9623-b17ad4b4f033 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:06.552543 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-8978b0ea-f2ef-4acf-a8f4-50ef05e9e1f6 req-5f34fd88-b042-434f-9623-b17ad4b4f033 service nova] Creating event network-changed:ebfc41b8-372f-4c67-97e3-7caa675975ac for instance ad92550c-f29b-4f97-9511-a2f1ffa98e3e on hv-cinder-84496 Aug 31 09:51:06.562190 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-8978b0ea-f2ef-4acf-a8f4-50ef05e9e1f6 req-5f34fd88-b042-434f-9623-b17ad4b4f033 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073751 Aug 31 09:51:06.564017 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 175/365] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:51:06.937762 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-aae9f31b-0a83-41be-a59b-2d85ca18386d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:06.939320 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-aae9f31b-0a83-41be-a59b-2d85ca18386d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:06.946481 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-aae9f31b-0a83-41be-a59b-2d85ca18386d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:06.946892 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-aae9f31b-0a83-41be-a59b-2d85ca18386d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:06.947334 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-aae9f31b-0a83-41be-a59b-2d85ca18386d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:06.948130 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-aae9f31b-0a83-41be-a59b-2d85ca18386d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:06.948771 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-aae9f31b-0a83-41be-a59b-2d85ca18386d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:06.949370 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-aae9f31b-0a83-41be-a59b-2d85ca18386d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:07.171286 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-aae9f31b-0a83-41be-a59b-2d85ca18386d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:07.190127 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-aae9f31b-0a83-41be-a59b-2d85ca18386d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1370 microversion: 2.1 time: 0.256976 Aug 31 09:51:07.191761 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 191/366] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:06 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1370 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:08.220468 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-1200d472-eb45-4ef6-91ba-2900b62f00be tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:08.221188 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-1200d472-eb45-4ef6-91ba-2900b62f00be tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:08.226024 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=2 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:08.226984 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=6 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:08.236943 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1200d472-eb45-4ef6-91ba-2900b62f00be tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:08.237792 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1200d472-eb45-4ef6-91ba-2900b62f00be tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:08.238238 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1200d472-eb45-4ef6-91ba-2900b62f00be tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:08.238964 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1200d472-eb45-4ef6-91ba-2900b62f00be tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:08.239429 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1200d472-eb45-4ef6-91ba-2900b62f00be tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:08.240052 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1200d472-eb45-4ef6-91ba-2900b62f00be tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:08.433048 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-1200d472-eb45-4ef6-91ba-2900b62f00be tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:08.443471 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-1200d472-eb45-4ef6-91ba-2900b62f00be tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1370 microversion: 2.1 time: 0.234169 Aug 31 09:51:08.444082 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 176/367] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:08 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1370 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:09.468665 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-4ee376d9-9de7-4989-af04-3873d02dd74c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:09.470783 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-4ee376d9-9de7-4989-af04-3873d02dd74c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:09.476467 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=6 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:09.483848 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4ee376d9-9de7-4989-af04-3873d02dd74c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:09.486064 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4ee376d9-9de7-4989-af04-3873d02dd74c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:09.487807 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4ee376d9-9de7-4989-af04-3873d02dd74c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:09.489488 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4ee376d9-9de7-4989-af04-3873d02dd74c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:09.490855 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4ee376d9-9de7-4989-af04-3873d02dd74c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:09.491639 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4ee376d9-9de7-4989-af04-3873d02dd74c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:09.757413 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-4ee376d9-9de7-4989-af04-3873d02dd74c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:09.775985 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-4ee376d9-9de7-4989-af04-3873d02dd74c tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1370 microversion: 2.1 time: 0.313324 Aug 31 09:51:09.777839 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 192/368] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:09 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1370 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:10.812227 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-6ec605ea-0120-4cfc-8fa8-237ea3abf851 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:10.817890 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-6ec605ea-0120-4cfc-8fa8-237ea3abf851 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:10.841098 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6ec605ea-0120-4cfc-8fa8-237ea3abf851 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:10.843540 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6ec605ea-0120-4cfc-8fa8-237ea3abf851 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:10.844679 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6ec605ea-0120-4cfc-8fa8-237ea3abf851 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:10.854097 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6ec605ea-0120-4cfc-8fa8-237ea3abf851 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:10.856379 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6ec605ea-0120-4cfc-8fa8-237ea3abf851 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:10.857623 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6ec605ea-0120-4cfc-8fa8-237ea3abf851 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:11.216823 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-6ec605ea-0120-4cfc-8fa8-237ea3abf851 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:11.234146 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-6ec605ea-0120-4cfc-8fa8-237ea3abf851 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1370 microversion: 2.1 time: 0.438625 Aug 31 09:51:11.235455 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 177/369] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:10 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1370 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:12.271792 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f4d82ef6-1fa9-443e-ba06-4e972798a23f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:12.273921 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-f4d82ef6-1fa9-443e-ba06-4e972798a23f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:12.283503 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f4d82ef6-1fa9-443e-ba06-4e972798a23f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:12.284503 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f4d82ef6-1fa9-443e-ba06-4e972798a23f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:12.285247 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f4d82ef6-1fa9-443e-ba06-4e972798a23f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:12.286395 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f4d82ef6-1fa9-443e-ba06-4e972798a23f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:12.287207 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f4d82ef6-1fa9-443e-ba06-4e972798a23f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:12.287815 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f4d82ef6-1fa9-443e-ba06-4e972798a23f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:12.652385 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-f4d82ef6-1fa9-443e-ba06-4e972798a23f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:12.675497 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-f4d82ef6-1fa9-443e-ba06-4e972798a23f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1370 microversion: 2.1 time: 0.409315 Aug 31 09:51:12.681275 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 193/370] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:12 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1370 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:51:13.741736 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-91c00ae9-03ea-455a-8bbe-0f656d60e2ff tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:13.743253 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-91c00ae9-03ea-455a-8bbe-0f656d60e2ff tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:13.759395 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-91c00ae9-03ea-455a-8bbe-0f656d60e2ff tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:13.768037 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-91c00ae9-03ea-455a-8bbe-0f656d60e2ff tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:13.769361 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-91c00ae9-03ea-455a-8bbe-0f656d60e2ff tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:13.770948 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-91c00ae9-03ea-455a-8bbe-0f656d60e2ff tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:13.772042 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-91c00ae9-03ea-455a-8bbe-0f656d60e2ff tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:13.773021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-91c00ae9-03ea-455a-8bbe-0f656d60e2ff tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:13.810792 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-d3aeb11a-1e19-4297-aeae-e0ea9e3294db req-63ecae3e-c987-4a9b-80eb-764ac736ad11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad92550c-f29b-4f97-9511-a2f1ffa98e3e", "name": "network-vif-plugged", "status": "completed", "tag": "ebfc41b8-372f-4c67-97e3-7caa675975ac"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:13.851233 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-d3aeb11a-1e19-4297-aeae-e0ea9e3294db req-63ecae3e-c987-4a9b-80eb-764ac736ad11 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:13.860011 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-d3aeb11a-1e19-4297-aeae-e0ea9e3294db req-63ecae3e-c987-4a9b-80eb-764ac736ad11 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:13.861437 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-d3aeb11a-1e19-4297-aeae-e0ea9e3294db req-63ecae3e-c987-4a9b-80eb-764ac736ad11 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:13.894202 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-d3aeb11a-1e19-4297-aeae-e0ea9e3294db req-63ecae3e-c987-4a9b-80eb-764ac736ad11 service nova] Creating event network-vif-plugged:ebfc41b8-372f-4c67-97e3-7caa675975ac for instance ad92550c-f29b-4f97-9511-a2f1ffa98e3e on hv-cinder-84496 Aug 31 09:51:13.900637 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-d3aeb11a-1e19-4297-aeae-e0ea9e3294db req-63ecae3e-c987-4a9b-80eb-764ac736ad11 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098077 Aug 31 09:51:13.902493 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 194/371] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:51:14.427284 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-91c00ae9-03ea-455a-8bbe-0f656d60e2ff tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:14.460140 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-91c00ae9-03ea-455a-8bbe-0f656d60e2ff tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1370 microversion: 2.1 time: 0.743199 Aug 31 09:51:14.461807 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 178/372] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:13 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1370 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:15.490312 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-c7c24e88-d071-49a0-abf0-dc0a3631b7b8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:15.492823 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-c7c24e88-d071-49a0-abf0-dc0a3631b7b8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:15.505654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c7c24e88-d071-49a0-abf0-dc0a3631b7b8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:15.506880 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c7c24e88-d071-49a0-abf0-dc0a3631b7b8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:15.507948 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c7c24e88-d071-49a0-abf0-dc0a3631b7b8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:15.509261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c7c24e88-d071-49a0-abf0-dc0a3631b7b8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:15.510132 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c7c24e88-d071-49a0-abf0-dc0a3631b7b8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:15.510918 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c7c24e88-d071-49a0-abf0-dc0a3631b7b8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:15.984753 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-c7c24e88-d071-49a0-abf0-dc0a3631b7b8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:15.993309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-c7c24e88-d071-49a0-abf0-dc0a3631b7b8 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1370 microversion: 2.1 time: 0.513289 Aug 31 09:51:15.994253 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 195/373] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:15 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1370 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:51:17.028260 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-82b6c66c-44c4-4402-9c7f-a5432723baa7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:17.034585 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-82b6c66c-44c4-4402-9c7f-a5432723baa7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:17.051903 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-82b6c66c-44c4-4402-9c7f-a5432723baa7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:17.053121 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-82b6c66c-44c4-4402-9c7f-a5432723baa7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:17.054977 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-82b6c66c-44c4-4402-9c7f-a5432723baa7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:17.056880 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-82b6c66c-44c4-4402-9c7f-a5432723baa7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:17.057871 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-82b6c66c-44c4-4402-9c7f-a5432723baa7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:17.059377 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-82b6c66c-44c4-4402-9c7f-a5432723baa7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:17.069326 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=62 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:17.613053 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-82b6c66c-44c4-4402-9c7f-a5432723baa7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:17.659507 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-82b6c66c-44c4-4402-9c7f-a5432723baa7 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1564 microversion: 2.1 time: 0.645427 Aug 31 09:51:17.664089 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 179/374] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:17 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1564 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:17.691698 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-5cfb8476-c7e2-4042-9f1f-70b28f33b1de tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:17.692627 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-5cfb8476-c7e2-4042-9f1f-70b28f33b1de tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:17.712267 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5cfb8476-c7e2-4042-9f1f-70b28f33b1de tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:17.712788 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5cfb8476-c7e2-4042-9f1f-70b28f33b1de tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:17.713468 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5cfb8476-c7e2-4042-9f1f-70b28f33b1de tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:17.716891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5cfb8476-c7e2-4042-9f1f-70b28f33b1de tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:17.717729 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5cfb8476-c7e2-4042-9f1f-70b28f33b1de tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:17.721220 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5cfb8476-c7e2-4042-9f1f-70b28f33b1de tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:17.882112 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-5cfb8476-c7e2-4042-9f1f-70b28f33b1de tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.196771 Aug 31 09:51:17.882720 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 196/375] 10.222.0.13 () {58 vars in 1275 bytes} [Wed Aug 31 09:51:17 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e/os-interface => generated 284 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:51:21.274696 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-b5288968-a425-4b71-a82c-37b24dc30409 req-ac2debfa-6436-41b5-9f8d-b2cd460a84cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad92550c-f29b-4f97-9511-a2f1ffa98e3e", "tag": "ebfc41b8-372f-4c67-97e3-7caa675975ac"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:21.289099 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-b5288968-a425-4b71-a82c-37b24dc30409 req-ac2debfa-6436-41b5-9f8d-b2cd460a84cd service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:21.289978 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-b5288968-a425-4b71-a82c-37b24dc30409 req-ac2debfa-6436-41b5-9f8d-b2cd460a84cd service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:21.290575 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-b5288968-a425-4b71-a82c-37b24dc30409 req-ac2debfa-6436-41b5-9f8d-b2cd460a84cd service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:21.312878 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-b5288968-a425-4b71-a82c-37b24dc30409 req-ac2debfa-6436-41b5-9f8d-b2cd460a84cd service nova] Creating event network-changed:ebfc41b8-372f-4c67-97e3-7caa675975ac for instance ad92550c-f29b-4f97-9511-a2f1ffa98e3e on hv-cinder-84496 Aug 31 09:51:21.323832 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-b5288968-a425-4b71-a82c-37b24dc30409 req-ac2debfa-6436-41b5-9f8d-b2cd460a84cd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066689 Aug 31 09:51:21.328230 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 180/376] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:51:30.255487 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=15 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:30.257299 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=47 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:30.883254 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-110ee63e-07ab-4539-a7a5-be05c97eaf4e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Action: 'create', calling method: .version_select at 0x7f5503f081f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-235501854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsg5gkJzzrj4eEIaC5WaqVYSqn1hElqOjBqDDglmpUb8nnHiA6E5ogMEMoOHFSro7rjP4ACKoJJZV3Xx37d254fvAKd373sr6qC0segdj3OlZ0L5pft2CteDR9+9aFqZw=="}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:30.906748 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-110ee63e-07ab-4539-a7a5-be05c97eaf4e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Getting quotas for project 6634173c9d534fca800d394d545a9d0c. Resources: {'key_pairs'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:51:30.915241 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-110ee63e-07ab-4539-a7a5-be05c97eaf4e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Getting quotas for user 1090c027746845239055973b44207556 and project 6634173c9d534fca800d394d545a9d0c. Resources: {'key_pairs'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:51:30.956832 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-110ee63e-07ab-4539-a7a5-be05c97eaf4e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.700799 Aug 31 09:51:30.957052 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 197/377] 10.222.0.13 () {60 vars in 1159 bytes} [Wed Aug 31 09:51:30 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:51:31.212227 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-b4222e7e-57e1-4123-b002-14bf6ac086bc tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Action: 'create', calling method: .version_select at 0x7f5503f71820>, body: {"keypair": {"name": "tempest-TestShelveInstance-806524526", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNS6U5NE9zg4yK9+4vVCmEr232bLeVLRG2X837VKWANzcFBzeenZL0+RL8qtxSqA5//vH3GBQ0Abi1rOTsHxiUkuU6PLKwDCiWx/djvuR4rfSXz38of1tEuNNJMESGI0Q=="}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:31.237664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-b4222e7e-57e1-4123-b002-14bf6ac086bc tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Getting quotas for project b058d5f34eee47a58629407e166f3499. Resources: {'key_pairs'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:51:31.242300 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-b4222e7e-57e1-4123-b002-14bf6ac086bc tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Getting quotas for user c89dbe311b24408c925f102eefd6d8c3 and project b058d5f34eee47a58629407e166f3499. Resources: {'key_pairs'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:51:31.275244 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-b4222e7e-57e1-4123-b002-14bf6ac086bc tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.254845 Aug 31 09:51:31.275863 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 181/378] 10.222.0.13 () {60 vars in 1159 bytes} [Wed Aug 31 09:51:31 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:51:38.463310 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b1b97815-82fa-4cdf-9290-04c2081f1650 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:38.464120 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b1b97815-82fa-4cdf-9290-04c2081f1650 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:38.471012 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b1b97815-82fa-4cdf-9290-04c2081f1650 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:38.471756 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b1b97815-82fa-4cdf-9290-04c2081f1650 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:38.472198 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b1b97815-82fa-4cdf-9290-04c2081f1650 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:38.472898 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b1b97815-82fa-4cdf-9290-04c2081f1650 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:38.473355 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b1b97815-82fa-4cdf-9290-04c2081f1650 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:38.473795 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b1b97815-82fa-4cdf-9290-04c2081f1650 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:38.512143 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b1b97815-82fa-4cdf-9290-04c2081f1650 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8/ips" status: 200 len: 146 microversion: 2.1 time: 0.052687 Aug 31 09:51:38.512745 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 198/379] 10.222.0.13 () {58 vars in 1248 bytes} [Wed Aug 31 09:51:38 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8/ips => generated 146 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:51:50.247996 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=7 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:50.249235 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=4 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:50.249932 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:50.255526 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-01c44d57-e93c-4e08-9df7-1eb250ed8c36 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f91fc1ad-01df-4111-9f05-1240f48b63e3"}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:50.258737 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-01c44d57-e93c-4e08-9df7-1eb250ed8c36 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:50.267465 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-01c44d57-e93c-4e08-9df7-1eb250ed8c36 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:50.267943 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-01c44d57-e93c-4e08-9df7-1eb250ed8c36 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:50.268377 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-01c44d57-e93c-4e08-9df7-1eb250ed8c36 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:50.269072 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-01c44d57-e93c-4e08-9df7-1eb250ed8c36 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:50.269553 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-01c44d57-e93c-4e08-9df7-1eb250ed8c36 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:50.269984 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-01c44d57-e93c-4e08-9df7-1eb250ed8c36 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:50.580527 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-01c44d57-e93c-4e08-9df7-1eb250ed8c36 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "POST /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333340 Aug 31 09:51:50.581210 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 182/380] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 31 09:51:50 2022] POST /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:51:59.260716 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-47589663-4146-4470-bd79-0bb7f3b804aa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:59.264319 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=4 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:59.265239 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:59.265893 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=4 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:59.270840 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-47589663-4146-4470-bd79-0bb7f3b804aa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:59.271333 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-47589663-4146-4470-bd79-0bb7f3b804aa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:59.272083 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-47589663-4146-4470-bd79-0bb7f3b804aa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:59.336702 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-47589663-4146-4470-bd79-0bb7f3b804aa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Going to try to stop instance {{(pid=127170) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 09:51:59.389426 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-47589663-4146-4470-bd79-0bb7f3b804aa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "POST /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8/action" status: 202 len: 0 microversion: 2.1 time: 0.132878 Aug 31 09:51:59.390433 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 199/381] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 31 09:51:59 2022] POST /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:51:59.403047 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-f5ef6985-bf0e-45e8-b1f1-30186667994e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:59.403672 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-f5ef6985-bf0e-45e8-b1f1-30186667994e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:59.412216 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f5ef6985-bf0e-45e8-b1f1-30186667994e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:59.412709 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f5ef6985-bf0e-45e8-b1f1-30186667994e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:59.413147 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f5ef6985-bf0e-45e8-b1f1-30186667994e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:59.413900 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f5ef6985-bf0e-45e8-b1f1-30186667994e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:59.414353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f5ef6985-bf0e-45e8-b1f1-30186667994e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:59.414978 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f5ef6985-bf0e-45e8-b1f1-30186667994e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:59.564421 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-f5ef6985-bf0e-45e8-b1f1-30186667994e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:59.573177 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-f5ef6985-bf0e-45e8-b1f1-30186667994e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1724 microversion: 2.1 time: 0.175794 Aug 31 09:51:59.573785 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 183/382] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:59 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:00.595702 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f3364bb4-167a-438f-895d-d5683c345efa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:00.596397 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-f3364bb4-167a-438f-895d-d5683c345efa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:00.602759 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f3364bb4-167a-438f-895d-d5683c345efa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:00.603237 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f3364bb4-167a-438f-895d-d5683c345efa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:00.603660 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f3364bb4-167a-438f-895d-d5683c345efa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:00.604335 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f3364bb4-167a-438f-895d-d5683c345efa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:00.604775 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f3364bb4-167a-438f-895d-d5683c345efa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:00.605195 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f3364bb4-167a-438f-895d-d5683c345efa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:00.736236 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-f3364bb4-167a-438f-895d-d5683c345efa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:00.744736 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-f3364bb4-167a-438f-895d-d5683c345efa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1724 microversion: 2.1 time: 0.153880 Aug 31 09:52:00.745304 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 200/383] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:00 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:01.434547 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-763ef5ad-17cc-4fb5-b441-62afffba86ae tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1426392767", "imageRef": "8e078bb9-f274-4984-8128-d31407d49604", "flavorRef": "452", "networks": [{"uuid": "3721ce91-1e27-4c65-a4af-3dca7c9d9b7d"}]}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:01.490431 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.network.neutron [None req-763ef5ad-17cc-4fb5-b441-62afffba86ae tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] validate_networks() for [('3721ce91-1e27-4c65-a4af-3dca7c9d9b7d', None, None, None, None, None)] {{(pid=127171) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:52:01.766205 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-308e01f4-f9a8-44d3-b2ec-e655634d6d3a tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:01.768479 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-308e01f4-f9a8-44d3-b2ec-e655634d6d3a tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:01.774285 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-308e01f4-f9a8-44d3-b2ec-e655634d6d3a tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:01.774762 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-308e01f4-f9a8-44d3-b2ec-e655634d6d3a tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:01.775191 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-308e01f4-f9a8-44d3-b2ec-e655634d6d3a tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:01.775882 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-308e01f4-f9a8-44d3-b2ec-e655634d6d3a tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:01.776326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-308e01f4-f9a8-44d3-b2ec-e655634d6d3a tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:01.776742 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-308e01f4-f9a8-44d3-b2ec-e655634d6d3a tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:01.925161 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-763ef5ad-17cc-4fb5-b441-62afffba86ae tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Flavor limits 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:52:01.925629 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-763ef5ad-17cc-4fb5-b441-62afffba86ae tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Image limits 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:52:01.926100 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-763ef5ad-17cc-4fb5-b441-62afffba86ae tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Flavor pref 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:52:01.926507 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-763ef5ad-17cc-4fb5-b441-62afffba86ae tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Image pref 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:52:01.926917 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-763ef5ad-17cc-4fb5-b441-62afffba86ae tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:52:01.935796 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-763ef5ad-17cc-4fb5-b441-62afffba86ae tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:01.936279 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-763ef5ad-17cc-4fb5-b441-62afffba86ae tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:01.936711 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-763ef5ad-17cc-4fb5-b441-62afffba86ae tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:01.937466 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-763ef5ad-17cc-4fb5-b441-62afffba86ae tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:01.937917 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-763ef5ad-17cc-4fb5-b441-62afffba86ae tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:01.938336 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-763ef5ad-17cc-4fb5-b441-62afffba86ae tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:01.950958 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-308e01f4-f9a8-44d3-b2ec-e655634d6d3a tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:01.956420 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-763ef5ad-17cc-4fb5-b441-62afffba86ae tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Getting quotas for project f8336bd8ac0c4600a25261e1af19a7df. Resources: {'ram', 'instances', 'cores'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:52:01.959976 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-308e01f4-f9a8-44d3-b2ec-e655634d6d3a tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1724 microversion: 2.1 time: 0.197677 Aug 31 09:52:01.960549 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 201/384] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:01 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:01.960824 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-763ef5ad-17cc-4fb5-b441-62afffba86ae tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Getting quotas for user f62009b582dd480198ceca6f41e255c2 and project f8336bd8ac0c4600a25261e1af19a7df. Resources: {'ram', 'instances', 'cores'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:52:01.982572 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-763ef5ad-17cc-4fb5-b441-62afffba86ae tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Going to run 1 instances... {{(pid=127171) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:52:01.984919 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-763ef5ad-17cc-4fb5-b441-62afffba86ae tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: 16c07355-b5dd-4e8e-a8bb-e431caacdb59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8e078bb9-f274-4984-8128-d31407d49604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:52:02.032515 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-763ef5ad-17cc-4fb5-b441-62afffba86ae tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601791 Aug 31 09:52:02.033621 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 184/385] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 31 09:52:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:52:02.044120 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-bea193ab-98e4-4b85-9967-252672350604 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:02.044717 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-bea193ab-98e4-4b85-9967-252672350604 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: 16c07355-b5dd-4e8e-a8bb-e431caacdb59] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:02.102288 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-bea193ab-98e4-4b85-9967-252672350604 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:02.109493 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-bea193ab-98e4-4b85-9967-252672350604 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59" status: 200 len: 1219 microversion: 2.1 time: 0.069106 Aug 31 09:52:02.110057 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 202/386] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:02 2022] GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:02.982743 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c9f47ed7-5523-408e-9e0a-548288e5163b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:02.983362 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c9f47ed7-5523-408e-9e0a-548288e5163b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:02.991667 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c9f47ed7-5523-408e-9e0a-548288e5163b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:02.992381 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c9f47ed7-5523-408e-9e0a-548288e5163b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:02.993031 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c9f47ed7-5523-408e-9e0a-548288e5163b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:02.994127 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c9f47ed7-5523-408e-9e0a-548288e5163b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:02.994732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c9f47ed7-5523-408e-9e0a-548288e5163b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:02.995363 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c9f47ed7-5523-408e-9e0a-548288e5163b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:03.130904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-52b304b0-d88a-4907-95c0-939a9ce607b8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:03.131711 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-52b304b0-d88a-4907-95c0-939a9ce607b8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: 16c07355-b5dd-4e8e-a8bb-e431caacdb59] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:03.137714 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-52b304b0-d88a-4907-95c0-939a9ce607b8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:03.138201 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-52b304b0-d88a-4907-95c0-939a9ce607b8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:03.138628 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-52b304b0-d88a-4907-95c0-939a9ce607b8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:03.139341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-52b304b0-d88a-4907-95c0-939a9ce607b8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:03.139779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-52b304b0-d88a-4907-95c0-939a9ce607b8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:03.140386 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-52b304b0-d88a-4907-95c0-939a9ce607b8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:03.149702 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c9f47ed7-5523-408e-9e0a-548288e5163b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:03.170509 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c9f47ed7-5523-408e-9e0a-548288e5163b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1724 microversion: 2.1 time: 0.191995 Aug 31 09:52:03.171301 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 185/387] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:02 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:03.206355 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-52b304b0-d88a-4907-95c0-939a9ce607b8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:03.215887 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-52b304b0-d88a-4907-95c0-939a9ce607b8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59" status: 200 len: 1271 microversion: 2.1 time: 0.088841 Aug 31 09:52:03.216529 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 203/388] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:03 2022] GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59 => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:04.201179 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9def0125-b63e-4d12-b2da-ac747e624021 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:04.205189 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-9def0125-b63e-4d12-b2da-ac747e624021 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:04.213311 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9def0125-b63e-4d12-b2da-ac747e624021 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:04.214663 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9def0125-b63e-4d12-b2da-ac747e624021 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:04.215560 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9def0125-b63e-4d12-b2da-ac747e624021 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:04.217213 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9def0125-b63e-4d12-b2da-ac747e624021 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:04.218398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9def0125-b63e-4d12-b2da-ac747e624021 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:04.219527 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9def0125-b63e-4d12-b2da-ac747e624021 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:04.243395 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-1073d921-993b-41c4-bd08-5619562764c6 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:04.244529 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-1073d921-993b-41c4-bd08-5619562764c6 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: 16c07355-b5dd-4e8e-a8bb-e431caacdb59] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:04.256897 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1073d921-993b-41c4-bd08-5619562764c6 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:04.257683 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1073d921-993b-41c4-bd08-5619562764c6 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:04.258389 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1073d921-993b-41c4-bd08-5619562764c6 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:04.259208 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1073d921-993b-41c4-bd08-5619562764c6 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:04.259814 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1073d921-993b-41c4-bd08-5619562764c6 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:04.260525 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1073d921-993b-41c4-bd08-5619562764c6 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:04.472218 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-9def0125-b63e-4d12-b2da-ac747e624021 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:04.479640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-1073d921-993b-41c4-bd08-5619562764c6 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:04.482546 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-9def0125-b63e-4d12-b2da-ac747e624021 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1724 microversion: 2.1 time: 0.286324 Aug 31 09:52:04.490428 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 186/389] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:04 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1724 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:04.491489 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-1073d921-993b-41c4-bd08-5619562764c6 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59" status: 200 len: 1319 microversion: 2.1 time: 0.253218 Aug 31 09:52:04.492245 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 204/390] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:04 2022] GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:04.965879 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-c1823e7b-1560-422e-b419-7b4fa4c9e844 req-905f4bf4-69b6-46e6-afb2-eff6af96fab1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16c07355-b5dd-4e8e-a8bb-e431caacdb59", "tag": "ce4ee85e-37ea-4686-8ab1-e9a7cbf3d530"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:04.982814 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-c1823e7b-1560-422e-b419-7b4fa4c9e844 req-905f4bf4-69b6-46e6-afb2-eff6af96fab1 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:04.983288 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-c1823e7b-1560-422e-b419-7b4fa4c9e844 req-905f4bf4-69b6-46e6-afb2-eff6af96fab1 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:04.983713 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-c1823e7b-1560-422e-b419-7b4fa4c9e844 req-905f4bf4-69b6-46e6-afb2-eff6af96fab1 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:04.998457 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-c1823e7b-1560-422e-b419-7b4fa4c9e844 req-905f4bf4-69b6-46e6-afb2-eff6af96fab1 service nova] Creating event network-changed:ce4ee85e-37ea-4686-8ab1-e9a7cbf3d530 for instance 16c07355-b5dd-4e8e-a8bb-e431caacdb59 on hv-cinder-84496 Aug 31 09:52:05.004884 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-c1823e7b-1560-422e-b419-7b4fa4c9e844 req-905f4bf4-69b6-46e6-afb2-eff6af96fab1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044998 Aug 31 09:52:05.005557 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 187/391] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:52:05.509984 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-001a2ec7-2b59-4655-9a30-147e020fe1ed tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:05.511421 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-001a2ec7-2b59-4655-9a30-147e020fe1ed tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:05.513323 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-e0c0b55f-50b3-4748-b961-a9415a7dcb0e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:05.514795 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-e0c0b55f-50b3-4748-b961-a9415a7dcb0e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: 16c07355-b5dd-4e8e-a8bb-e431caacdb59] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:05.518705 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-001a2ec7-2b59-4655-9a30-147e020fe1ed tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:05.519198 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-001a2ec7-2b59-4655-9a30-147e020fe1ed tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:05.519632 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-001a2ec7-2b59-4655-9a30-147e020fe1ed tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:05.520349 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-001a2ec7-2b59-4655-9a30-147e020fe1ed tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:05.520835 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-001a2ec7-2b59-4655-9a30-147e020fe1ed tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:05.521259 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-001a2ec7-2b59-4655-9a30-147e020fe1ed tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:05.526881 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e0c0b55f-50b3-4748-b961-a9415a7dcb0e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:05.527385 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e0c0b55f-50b3-4748-b961-a9415a7dcb0e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:05.527973 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e0c0b55f-50b3-4748-b961-a9415a7dcb0e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:05.528801 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e0c0b55f-50b3-4748-b961-a9415a7dcb0e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:05.529252 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e0c0b55f-50b3-4748-b961-a9415a7dcb0e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:05.529694 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e0c0b55f-50b3-4748-b961-a9415a7dcb0e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:05.753371 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-001a2ec7-2b59-4655-9a30-147e020fe1ed tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:05.762417 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-001a2ec7-2b59-4655-9a30-147e020fe1ed tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1724 microversion: 2.1 time: 0.259624 Aug 31 09:52:05.763036 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 205/392] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:05 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:05.765245 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-e0c0b55f-50b3-4748-b961-a9415a7dcb0e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:05.777706 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-e0c0b55f-50b3-4748-b961-a9415a7dcb0e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59" status: 200 len: 1319 microversion: 2.1 time: 0.268869 Aug 31 09:52:05.778301 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 188/393] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:05 2022] GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:06.784736 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-9369f292-33db-4aec-b958-5f0987208887 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:06.785345 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-9369f292-33db-4aec-b958-5f0987208887 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:06.799018 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-32b7ce0f-6e4c-4208-b16e-98ea7e87f1c3 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:06.799613 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9369f292-33db-4aec-b958-5f0987208887 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:06.799720 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-32b7ce0f-6e4c-4208-b16e-98ea7e87f1c3 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: 16c07355-b5dd-4e8e-a8bb-e431caacdb59] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:06.799984 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9369f292-33db-4aec-b958-5f0987208887 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:06.800458 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9369f292-33db-4aec-b958-5f0987208887 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:06.801173 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9369f292-33db-4aec-b958-5f0987208887 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:06.801677 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9369f292-33db-4aec-b958-5f0987208887 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:06.802101 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9369f292-33db-4aec-b958-5f0987208887 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:06.809204 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-32b7ce0f-6e4c-4208-b16e-98ea7e87f1c3 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:06.810650 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-32b7ce0f-6e4c-4208-b16e-98ea7e87f1c3 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:06.810650 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-32b7ce0f-6e4c-4208-b16e-98ea7e87f1c3 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:06.810855 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-32b7ce0f-6e4c-4208-b16e-98ea7e87f1c3 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:06.811284 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-32b7ce0f-6e4c-4208-b16e-98ea7e87f1c3 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:06.811699 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-32b7ce0f-6e4c-4208-b16e-98ea7e87f1c3 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:07.017732 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-9369f292-33db-4aec-b958-5f0987208887 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:07.027051 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-9369f292-33db-4aec-b958-5f0987208887 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1724 microversion: 2.1 time: 0.246568 Aug 31 09:52:07.027647 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 206/394] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:06 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:07.027823 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-32b7ce0f-6e4c-4208-b16e-98ea7e87f1c3 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:07.041985 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-32b7ce0f-6e4c-4208-b16e-98ea7e87f1c3 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59" status: 200 len: 1319 microversion: 2.1 time: 0.246231 Aug 31 09:52:07.042899 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 189/395] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:06 2022] GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:08.050437 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-14fce29f-dc0f-4dd9-a6c2-79a59c097be9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:08.051047 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-14fce29f-dc0f-4dd9-a6c2-79a59c097be9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:08.057728 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-14fce29f-dc0f-4dd9-a6c2-79a59c097be9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:08.058366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-14fce29f-dc0f-4dd9-a6c2-79a59c097be9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:08.058927 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-14fce29f-dc0f-4dd9-a6c2-79a59c097be9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:08.060264 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-14fce29f-dc0f-4dd9-a6c2-79a59c097be9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:08.060571 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-14fce29f-dc0f-4dd9-a6c2-79a59c097be9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:08.062274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-14fce29f-dc0f-4dd9-a6c2-79a59c097be9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:08.066958 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-ff78c8ce-c1ee-41aa-adda-7302d7a27c2b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:08.067786 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-ff78c8ce-c1ee-41aa-adda-7302d7a27c2b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: 16c07355-b5dd-4e8e-a8bb-e431caacdb59] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:08.076452 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ff78c8ce-c1ee-41aa-adda-7302d7a27c2b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:08.080254 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ff78c8ce-c1ee-41aa-adda-7302d7a27c2b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:08.080254 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ff78c8ce-c1ee-41aa-adda-7302d7a27c2b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:08.080254 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ff78c8ce-c1ee-41aa-adda-7302d7a27c2b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:08.080254 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ff78c8ce-c1ee-41aa-adda-7302d7a27c2b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:08.080852 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ff78c8ce-c1ee-41aa-adda-7302d7a27c2b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:08.324462 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-14fce29f-dc0f-4dd9-a6c2-79a59c097be9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:08.333647 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-ff78c8ce-c1ee-41aa-adda-7302d7a27c2b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:08.335690 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-14fce29f-dc0f-4dd9-a6c2-79a59c097be9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1724 microversion: 2.1 time: 0.289061 Aug 31 09:52:08.336287 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 207/396] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:08 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1724 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:08.347666 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-ff78c8ce-c1ee-41aa-adda-7302d7a27c2b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59" status: 200 len: 1319 microversion: 2.1 time: 0.285847 Aug 31 09:52:08.348470 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 190/397] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:08 2022] GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59 => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:09.366554 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b37bf443-68d5-4aa1-8377-04a033b5ce78 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:09.367689 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b37bf443-68d5-4aa1-8377-04a033b5ce78 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:09.370342 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-e50a9de0-a993-4d9b-9440-606ce19b99c2 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:09.371216 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-e50a9de0-a993-4d9b-9440-606ce19b99c2 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: 16c07355-b5dd-4e8e-a8bb-e431caacdb59] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:09.376600 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b37bf443-68d5-4aa1-8377-04a033b5ce78 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:09.377456 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b37bf443-68d5-4aa1-8377-04a033b5ce78 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:09.378185 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b37bf443-68d5-4aa1-8377-04a033b5ce78 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:09.379372 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b37bf443-68d5-4aa1-8377-04a033b5ce78 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:09.380145 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b37bf443-68d5-4aa1-8377-04a033b5ce78 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:09.380877 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e50a9de0-a993-4d9b-9440-606ce19b99c2 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:09.381005 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b37bf443-68d5-4aa1-8377-04a033b5ce78 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:09.381370 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e50a9de0-a993-4d9b-9440-606ce19b99c2 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:09.381836 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e50a9de0-a993-4d9b-9440-606ce19b99c2 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:09.382532 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e50a9de0-a993-4d9b-9440-606ce19b99c2 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:09.382983 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e50a9de0-a993-4d9b-9440-606ce19b99c2 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:09.383397 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e50a9de0-a993-4d9b-9440-606ce19b99c2 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:09.591746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b37bf443-68d5-4aa1-8377-04a033b5ce78 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:09.605632 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b37bf443-68d5-4aa1-8377-04a033b5ce78 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1724 microversion: 2.1 time: 0.245098 Aug 31 09:52:09.606316 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 208/398] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:09 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:09.608967 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-e50a9de0-a993-4d9b-9440-606ce19b99c2 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:09.627884 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-e50a9de0-a993-4d9b-9440-606ce19b99c2 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59" status: 200 len: 1319 microversion: 2.1 time: 0.261207 Aug 31 09:52:09.628514 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 191/399] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:09 2022] GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59 => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:10.639661 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-56592b89-6dc0-4e26-adab-06a6ba3bf180 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:10.640308 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-56592b89-6dc0-4e26-adab-06a6ba3bf180 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:10.649206 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-56592b89-6dc0-4e26-adab-06a6ba3bf180 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:10.649733 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-56592b89-6dc0-4e26-adab-06a6ba3bf180 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:10.650171 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-56592b89-6dc0-4e26-adab-06a6ba3bf180 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:10.650883 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-56592b89-6dc0-4e26-adab-06a6ba3bf180 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:10.651334 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-56592b89-6dc0-4e26-adab-06a6ba3bf180 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:10.651754 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-56592b89-6dc0-4e26-adab-06a6ba3bf180 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:10.656135 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-f34f9733-5cea-4127-af89-32af5032e5aa tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:10.657255 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-f34f9733-5cea-4127-af89-32af5032e5aa tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: 16c07355-b5dd-4e8e-a8bb-e431caacdb59] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:10.668007 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f34f9733-5cea-4127-af89-32af5032e5aa tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:10.668803 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f34f9733-5cea-4127-af89-32af5032e5aa tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:10.669639 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f34f9733-5cea-4127-af89-32af5032e5aa tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:10.670833 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f34f9733-5cea-4127-af89-32af5032e5aa tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:10.671630 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f34f9733-5cea-4127-af89-32af5032e5aa tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:10.672377 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f34f9733-5cea-4127-af89-32af5032e5aa tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:10.866108 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-56592b89-6dc0-4e26-adab-06a6ba3bf180 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:10.875475 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-56592b89-6dc0-4e26-adab-06a6ba3bf180 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1724 microversion: 2.1 time: 0.239964 Aug 31 09:52:10.877195 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 209/400] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:10 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:10.878912 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-f34f9733-5cea-4127-af89-32af5032e5aa tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:10.886771 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-f34f9733-5cea-4127-af89-32af5032e5aa tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59" status: 200 len: 1319 microversion: 2.1 time: 0.237782 Aug 31 09:52:10.887339 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 192/401] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:10 2022] GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:11.691897 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-9ab27018-4c19-44e8-b965-405cc1269c6d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-380088436", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-806524526", "security_groups": [{"name": "tempest-secgroup-smoke-994153412"}], "networks": [{"uuid": "177a62e1-5d2b-4e36-ba2d-27911ac1eac2"}], "block_device_mapping_v2": [{"uuid": "d83028f7-1499-40c2-9f62-b5c2debee745", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:11.842145 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.network.neutron [None req-9ab27018-4c19-44e8-b965-405cc1269c6d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] validate_networks() for [('177a62e1-5d2b-4e36-ba2d-27911ac1eac2', None, None, None, None, None)] {{(pid=127170) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:52:11.911744 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-90141e8d-d232-40e7-acb0-b7be38d557fb tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:11.913935 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-90141e8d-d232-40e7-acb0-b7be38d557fb tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:11.921912 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-90141e8d-d232-40e7-acb0-b7be38d557fb tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:11.922801 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-90141e8d-d232-40e7-acb0-b7be38d557fb tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:11.923521 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-90141e8d-d232-40e7-acb0-b7be38d557fb tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:11.924698 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-90141e8d-d232-40e7-acb0-b7be38d557fb tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:11.925917 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-90141e8d-d232-40e7-acb0-b7be38d557fb tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:11.926553 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-90141e8d-d232-40e7-acb0-b7be38d557fb tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:11.949827 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=2 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:11.976508 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=6 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:12.106418 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=2 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:12.169488 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-90141e8d-d232-40e7-acb0-b7be38d557fb tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:12.180341 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-90141e8d-d232-40e7-acb0-b7be38d557fb tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1701 microversion: 2.1 time: 0.273248 Aug 31 09:52:12.180926 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 193/402] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:11 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1701 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:12.186092 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-2833e003-554e-40ea-9b5e-2944e562552a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:12.186789 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-2833e003-554e-40ea-9b5e-2944e562552a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: 16c07355-b5dd-4e8e-a8bb-e431caacdb59] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:12.196908 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2833e003-554e-40ea-9b5e-2944e562552a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:12.197776 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2833e003-554e-40ea-9b5e-2944e562552a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:12.198272 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2833e003-554e-40ea-9b5e-2944e562552a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:12.199236 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2833e003-554e-40ea-9b5e-2944e562552a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:12.199855 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2833e003-554e-40ea-9b5e-2944e562552a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:12.200432 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2833e003-554e-40ea-9b5e-2944e562552a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:12.427787 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2833e003-554e-40ea-9b5e-2944e562552a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:12.435794 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-2833e003-554e-40ea-9b5e-2944e562552a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59" status: 200 len: 1319 microversion: 2.1 time: 0.253553 Aug 31 09:52:12.436387 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 194/403] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:12 2022] GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:12.442350 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-3d83a0ff-ab0b-410f-9d50-8e2487305cd5 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:12.449553 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3d83a0ff-ab0b-410f-9d50-8e2487305cd5 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:12.450047 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3d83a0ff-ab0b-410f-9d50-8e2487305cd5 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:12.450435 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3d83a0ff-ab0b-410f-9d50-8e2487305cd5 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:12.461697 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-9ab27018-4c19-44e8-b965-405cc1269c6d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Flavor limits 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:52:12.462116 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-9ab27018-4c19-44e8-b965-405cc1269c6d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Image limits 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:52:12.462771 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-9ab27018-4c19-44e8-b965-405cc1269c6d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Flavor pref 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:52:12.463180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-9ab27018-4c19-44e8-b965-405cc1269c6d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Image pref 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:52:12.463586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-9ab27018-4c19-44e8-b965-405cc1269c6d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:52:12.480219 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9ab27018-4c19-44e8-b965-405cc1269c6d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:12.480698 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9ab27018-4c19-44e8-b965-405cc1269c6d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:12.481842 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9ab27018-4c19-44e8-b965-405cc1269c6d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:12.482570 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9ab27018-4c19-44e8-b965-405cc1269c6d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:12.483018 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9ab27018-4c19-44e8-b965-405cc1269c6d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:12.483434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9ab27018-4c19-44e8-b965-405cc1269c6d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:12.506171 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-9ab27018-4c19-44e8-b965-405cc1269c6d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Getting quotas for project b058d5f34eee47a58629407e166f3499. Resources: {'ram', 'instances', 'cores'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:52:12.510578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-9ab27018-4c19-44e8-b965-405cc1269c6d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Getting quotas for user c89dbe311b24408c925f102eefd6d8c3 and project b058d5f34eee47a58629407e166f3499. Resources: {'ram', 'instances', 'cores'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:52:12.520187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-3d83a0ff-ab0b-410f-9d50-8e2487305cd5 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Going to try to start instance {{(pid=127171) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 09:52:12.572815 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-3d83a0ff-ab0b-410f-9d50-8e2487305cd5 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "POST /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8/action" status: 202 len: 0 microversion: 2.1 time: 0.135221 Aug 31 09:52:12.573693 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 195/404] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 31 09:52:12 2022] POST /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:52:12.582765 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-0caa1dfb-7629-453b-8e16-831b9c604baf tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:12.584105 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-0caa1dfb-7629-453b-8e16-831b9c604baf tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:12.592136 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0caa1dfb-7629-453b-8e16-831b9c604baf tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:12.592665 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0caa1dfb-7629-453b-8e16-831b9c604baf tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:12.593187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0caa1dfb-7629-453b-8e16-831b9c604baf tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:12.593911 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0caa1dfb-7629-453b-8e16-831b9c604baf tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:12.594477 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0caa1dfb-7629-453b-8e16-831b9c604baf tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:12.595068 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0caa1dfb-7629-453b-8e16-831b9c604baf tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:12.599148 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-9ab27018-4c19-44e8-b965-405cc1269c6d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Going to run 1 instances... {{(pid=127170) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:52:12.601564 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-9ab27018-4c19-44e8-b965-405cc1269c6d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d83028f7-1499-40c2-9f62-b5c2debee745',volume_size=None,volume_type=None)] {{(pid=127170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:52:12.767665 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-0caa1dfb-7629-453b-8e16-831b9c604baf tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:12.775891 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-0caa1dfb-7629-453b-8e16-831b9c604baf tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1710 microversion: 2.1 time: 0.197621 Aug 31 09:52:12.778294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-9ab27018-4c19-44e8-b965-405cc1269c6d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.090667 Aug 31 09:52:12.782660 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 210/405] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 31 09:52:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 09:52:12.791170 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 196/406] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:12 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1710 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:12.793709 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-7161d896-aafa-47c6-bd65-8fb66db63eec tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:12.794387 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-7161d896-aafa-47c6-bd65-8fb66db63eec tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:12.870352 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-7161d896-aafa-47c6-bd65-8fb66db63eec tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:12.880046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-7161d896-aafa-47c6-bd65-8fb66db63eec tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1087 microversion: 2.1 time: 0.092380 Aug 31 09:52:12.893410 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 211/407] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:12 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1087 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:13.459754 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c4624e3a-1931-4231-b963-8dd4f1846f88 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:13.460633 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c4624e3a-1931-4231-b963-8dd4f1846f88 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: 16c07355-b5dd-4e8e-a8bb-e431caacdb59] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:13.466928 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4624e3a-1931-4231-b963-8dd4f1846f88 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:13.467454 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4624e3a-1931-4231-b963-8dd4f1846f88 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:13.467894 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4624e3a-1931-4231-b963-8dd4f1846f88 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:13.468604 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4624e3a-1931-4231-b963-8dd4f1846f88 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:13.469076 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4624e3a-1931-4231-b963-8dd4f1846f88 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:13.469764 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4624e3a-1931-4231-b963-8dd4f1846f88 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:13.490599 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:13.637155 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c4624e3a-1931-4231-b963-8dd4f1846f88 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:13.645684 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c4624e3a-1931-4231-b963-8dd4f1846f88 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59" status: 200 len: 1319 microversion: 2.1 time: 0.189857 Aug 31 09:52:13.646445 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 197/408] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:13 2022] GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:13.798453 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-52c1a87c-5ede-4dd8-828e-15603b8785f8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:13.799321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-52c1a87c-5ede-4dd8-828e-15603b8785f8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:13.805271 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-52c1a87c-5ede-4dd8-828e-15603b8785f8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:13.805779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-52c1a87c-5ede-4dd8-828e-15603b8785f8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:13.806205 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-52c1a87c-5ede-4dd8-828e-15603b8785f8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:13.806928 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-52c1a87c-5ede-4dd8-828e-15603b8785f8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:13.807373 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-52c1a87c-5ede-4dd8-828e-15603b8785f8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:13.807791 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-52c1a87c-5ede-4dd8-828e-15603b8785f8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:13.902641 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-f6638362-57da-4e58-9c80-606f2e756853 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:13.903425 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-f6638362-57da-4e58-9c80-606f2e756853 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:13.910203 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f6638362-57da-4e58-9c80-606f2e756853 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:13.910695 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f6638362-57da-4e58-9c80-606f2e756853 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:13.911130 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f6638362-57da-4e58-9c80-606f2e756853 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:13.911836 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f6638362-57da-4e58-9c80-606f2e756853 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:13.912372 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f6638362-57da-4e58-9c80-606f2e756853 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:13.912710 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f6638362-57da-4e58-9c80-606f2e756853 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:13.945777 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-52c1a87c-5ede-4dd8-828e-15603b8785f8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:13.957447 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-52c1a87c-5ede-4dd8-828e-15603b8785f8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1710 microversion: 2.1 time: 0.163590 Aug 31 09:52:13.958148 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 212/409] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:13 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1710 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:13.975651 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-f6638362-57da-4e58-9c80-606f2e756853 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:13.984269 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-f6638362-57da-4e58-9c80-606f2e756853 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1185 microversion: 2.1 time: 0.086078 Aug 31 09:52:13.984844 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 198/410] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:13 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:14.501408 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-60b421d9-0f29-4d09-8acc-9707a591b5d6 req-edef3421-b17f-4288-9dda-3ee59dc810a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16c07355-b5dd-4e8e-a8bb-e431caacdb59", "name": "network-vif-plugged", "status": "completed", "tag": "ce4ee85e-37ea-4686-8ab1-e9a7cbf3d530"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:14.512623 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-60b421d9-0f29-4d09-8acc-9707a591b5d6 req-edef3421-b17f-4288-9dda-3ee59dc810a4 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:14.513356 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-60b421d9-0f29-4d09-8acc-9707a591b5d6 req-edef3421-b17f-4288-9dda-3ee59dc810a4 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:14.513840 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-60b421d9-0f29-4d09-8acc-9707a591b5d6 req-edef3421-b17f-4288-9dda-3ee59dc810a4 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:14.530018 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-60b421d9-0f29-4d09-8acc-9707a591b5d6 req-edef3421-b17f-4288-9dda-3ee59dc810a4 service nova] Creating event network-vif-plugged:ce4ee85e-37ea-4686-8ab1-e9a7cbf3d530 for instance 16c07355-b5dd-4e8e-a8bb-e431caacdb59 on hv-cinder-84496 Aug 31 09:52:14.536846 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-60b421d9-0f29-4d09-8acc-9707a591b5d6 req-edef3421-b17f-4288-9dda-3ee59dc810a4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040020 Aug 31 09:52:14.537476 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 213/411] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:52:14.668995 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-2a28162c-26cb-483f-ac19-35542d20a29a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:14.669655 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-2a28162c-26cb-483f-ac19-35542d20a29a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: 16c07355-b5dd-4e8e-a8bb-e431caacdb59] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:14.676646 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2a28162c-26cb-483f-ac19-35542d20a29a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:14.677144 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2a28162c-26cb-483f-ac19-35542d20a29a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:14.677611 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2a28162c-26cb-483f-ac19-35542d20a29a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:14.678314 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2a28162c-26cb-483f-ac19-35542d20a29a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:14.678763 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2a28162c-26cb-483f-ac19-35542d20a29a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:14.679184 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2a28162c-26cb-483f-ac19-35542d20a29a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:14.832330 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2a28162c-26cb-483f-ac19-35542d20a29a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:14.840317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-2a28162c-26cb-483f-ac19-35542d20a29a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59" status: 200 len: 1319 microversion: 2.1 time: 0.176972 Aug 31 09:52:14.840900 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 199/412] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:14 2022] GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:14.981553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-4ffae07b-b3b2-4cc6-baaf-4e79e0450761 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:14.982262 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-4ffae07b-b3b2-4cc6-baaf-4e79e0450761 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:14.989259 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4ffae07b-b3b2-4cc6-baaf-4e79e0450761 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:14.989776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4ffae07b-b3b2-4cc6-baaf-4e79e0450761 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:14.990219 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4ffae07b-b3b2-4cc6-baaf-4e79e0450761 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:14.990925 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4ffae07b-b3b2-4cc6-baaf-4e79e0450761 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:14.991378 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4ffae07b-b3b2-4cc6-baaf-4e79e0450761 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:14.991799 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4ffae07b-b3b2-4cc6-baaf-4e79e0450761 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:15.009216 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-0d8847dc-2284-423a-8fc8-e1876f2dd612 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:15.010011 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-0d8847dc-2284-423a-8fc8-e1876f2dd612 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:15.016194 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0d8847dc-2284-423a-8fc8-e1876f2dd612 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:15.016855 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0d8847dc-2284-423a-8fc8-e1876f2dd612 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:15.017290 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0d8847dc-2284-423a-8fc8-e1876f2dd612 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:15.018095 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0d8847dc-2284-423a-8fc8-e1876f2dd612 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:15.018543 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0d8847dc-2284-423a-8fc8-e1876f2dd612 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:15.018956 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0d8847dc-2284-423a-8fc8-e1876f2dd612 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:15.101053 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-0d8847dc-2284-423a-8fc8-e1876f2dd612 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:15.109189 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-0d8847dc-2284-423a-8fc8-e1876f2dd612 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1193 microversion: 2.1 time: 0.104252 Aug 31 09:52:15.109801 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 200/413] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:15 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1193 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:15.163820 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-4ffae07b-b3b2-4cc6-baaf-4e79e0450761 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:15.172134 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-4ffae07b-b3b2-4cc6-baaf-4e79e0450761 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1714 microversion: 2.1 time: 0.195568 Aug 31 09:52:15.173289 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 214/414] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:14 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1714 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:15.860838 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-324cc3ed-6a2e-47a8-8f9b-45ef808f958e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:15.861459 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-324cc3ed-6a2e-47a8-8f9b-45ef808f958e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: 16c07355-b5dd-4e8e-a8bb-e431caacdb59] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:15.867791 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-324cc3ed-6a2e-47a8-8f9b-45ef808f958e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:15.868282 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-324cc3ed-6a2e-47a8-8f9b-45ef808f958e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:15.868718 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-324cc3ed-6a2e-47a8-8f9b-45ef808f958e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:15.869434 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-324cc3ed-6a2e-47a8-8f9b-45ef808f958e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:15.869882 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-324cc3ed-6a2e-47a8-8f9b-45ef808f958e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:15.870302 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-324cc3ed-6a2e-47a8-8f9b-45ef808f958e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:16.025970 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-324cc3ed-6a2e-47a8-8f9b-45ef808f958e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:16.042454 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-324cc3ed-6a2e-47a8-8f9b-45ef808f958e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59" status: 200 len: 1319 microversion: 2.1 time: 0.185136 Aug 31 09:52:16.044744 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 201/415] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:15 2022] GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:16.132681 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-70df5bbc-8c2b-4d56-bb7f-f66648da4942 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:16.133460 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-70df5bbc-8c2b-4d56-bb7f-f66648da4942 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:16.147540 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-70df5bbc-8c2b-4d56-bb7f-f66648da4942 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:16.148102 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-70df5bbc-8c2b-4d56-bb7f-f66648da4942 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:16.148757 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-70df5bbc-8c2b-4d56-bb7f-f66648da4942 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:16.149713 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-70df5bbc-8c2b-4d56-bb7f-f66648da4942 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:16.150524 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-70df5bbc-8c2b-4d56-bb7f-f66648da4942 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:16.150976 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-70df5bbc-8c2b-4d56-bb7f-f66648da4942 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:16.314079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-70df5bbc-8c2b-4d56-bb7f-f66648da4942 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:16.322615 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-70df5bbc-8c2b-4d56-bb7f-f66648da4942 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1270 microversion: 2.1 time: 0.194624 Aug 31 09:52:16.323194 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 215/416] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:16 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1270 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:16.950488 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-b3b8c6b7-2c49-41ce-81ab-721ed13429f0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2013415188", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-235501854", "security_groups": [{"name": "tempest-secgroup-smoke-1528914323"}], "block_device_mapping_v2": [{"uuid": "143050a6-06e1-4d09-ab0e-e18840569eb5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b98f4fc3-1d55-4d78-8d5f-4e68e4b2b75a"}]}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:16.974403 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-53f964fd-f09b-4061-bd35-73fb8ee571ae req-1f90d4dc-9f96-45ef-93fd-575a829fc429 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b32c74c-ed7a-496f-bf84-ce2d50e8b808", "tag": "a4adc3c8-d787-4f05-8cd2-ace7305b75c0"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:17.009465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-53f964fd-f09b-4061-bd35-73fb8ee571ae req-1f90d4dc-9f96-45ef-93fd-575a829fc429 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:17.010240 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-53f964fd-f09b-4061-bd35-73fb8ee571ae req-1f90d4dc-9f96-45ef-93fd-575a829fc429 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:17.010932 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-53f964fd-f09b-4061-bd35-73fb8ee571ae req-1f90d4dc-9f96-45ef-93fd-575a829fc429 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:17.039151 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-53f964fd-f09b-4061-bd35-73fb8ee571ae req-1f90d4dc-9f96-45ef-93fd-575a829fc429 service nova] Creating event network-changed:a4adc3c8-d787-4f05-8cd2-ace7305b75c0 for instance 1b32c74c-ed7a-496f-bf84-ce2d50e8b808 on hv-cinder-84496 Aug 31 09:52:17.047072 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-53f964fd-f09b-4061-bd35-73fb8ee571ae req-1f90d4dc-9f96-45ef-93fd-575a829fc429 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083552 Aug 31 09:52:17.048525 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 216/417] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:52:17.065824 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-ca0a2acd-05b7-4054-b0a9-9217ce2ad430 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:17.066699 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-ca0a2acd-05b7-4054-b0a9-9217ce2ad430 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: 16c07355-b5dd-4e8e-a8bb-e431caacdb59] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:17.073830 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ca0a2acd-05b7-4054-b0a9-9217ce2ad430 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:17.074480 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ca0a2acd-05b7-4054-b0a9-9217ce2ad430 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:17.075014 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ca0a2acd-05b7-4054-b0a9-9217ce2ad430 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:17.075815 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ca0a2acd-05b7-4054-b0a9-9217ce2ad430 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:17.076365 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ca0a2acd-05b7-4054-b0a9-9217ce2ad430 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:17.076885 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ca0a2acd-05b7-4054-b0a9-9217ce2ad430 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:17.114235 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.network.neutron [None req-b3b8c6b7-2c49-41ce-81ab-721ed13429f0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] validate_networks() for [('b98f4fc3-1d55-4d78-8d5f-4e68e4b2b75a', None, None, None, None, None)] {{(pid=127171) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:52:17.306085 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-ca0a2acd-05b7-4054-b0a9-9217ce2ad430 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:17.315174 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-ca0a2acd-05b7-4054-b0a9-9217ce2ad430 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59" status: 200 len: 1319 microversion: 2.1 time: 0.254800 Aug 31 09:52:17.315773 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 217/418] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:17 2022] GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:17.344014 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-19d55644-e752-4141-8807-c2adb5225471 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:17.345218 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-19d55644-e752-4141-8807-c2adb5225471 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:17.363651 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-19d55644-e752-4141-8807-c2adb5225471 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:17.364440 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-19d55644-e752-4141-8807-c2adb5225471 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:17.364879 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-19d55644-e752-4141-8807-c2adb5225471 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:17.366140 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-19d55644-e752-4141-8807-c2adb5225471 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:17.366790 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-19d55644-e752-4141-8807-c2adb5225471 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:17.367439 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-19d55644-e752-4141-8807-c2adb5225471 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:17.393030 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:17.585513 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-19d55644-e752-4141-8807-c2adb5225471 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:17.594091 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-19d55644-e752-4141-8807-c2adb5225471 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1258 microversion: 2.1 time: 0.254082 Aug 31 09:52:17.594934 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 218/419] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:17 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1258 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:17.673850 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-b3b8c6b7-2c49-41ce-81ab-721ed13429f0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Flavor limits 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:52:17.674016 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-b3b8c6b7-2c49-41ce-81ab-721ed13429f0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Image limits 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:52:17.674443 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-b3b8c6b7-2c49-41ce-81ab-721ed13429f0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Flavor pref 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:52:17.674841 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-b3b8c6b7-2c49-41ce-81ab-721ed13429f0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Image pref 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:52:17.675275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-b3b8c6b7-2c49-41ce-81ab-721ed13429f0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:52:17.684116 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b3b8c6b7-2c49-41ce-81ab-721ed13429f0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:17.684588 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b3b8c6b7-2c49-41ce-81ab-721ed13429f0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:17.685011 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b3b8c6b7-2c49-41ce-81ab-721ed13429f0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:17.685756 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b3b8c6b7-2c49-41ce-81ab-721ed13429f0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:17.686191 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b3b8c6b7-2c49-41ce-81ab-721ed13429f0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:17.686610 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b3b8c6b7-2c49-41ce-81ab-721ed13429f0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:17.712898 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-b3b8c6b7-2c49-41ce-81ab-721ed13429f0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Getting quotas for project 6634173c9d534fca800d394d545a9d0c. Resources: {'ram', 'instances', 'cores'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:52:17.717772 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-b3b8c6b7-2c49-41ce-81ab-721ed13429f0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Getting quotas for user 1090c027746845239055973b44207556 and project 6634173c9d534fca800d394d545a9d0c. Resources: {'ram', 'instances', 'cores'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:52:17.784530 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-b3b8c6b7-2c49-41ce-81ab-721ed13429f0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Going to run 1 instances... {{(pid=127171) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:52:17.787738 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-b3b8c6b7-2c49-41ce-81ab-721ed13429f0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='143050a6-06e1-4d09-ab0e-e18840569eb5',volume_size=None,volume_type=None)] {{(pid=127171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:52:17.961103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-b3b8c6b7-2c49-41ce-81ab-721ed13429f0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.016889 Aug 31 09:52:17.972341 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 202/420] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 31 09:52:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:52:17.978730 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-41e9155c-dd8e-4d8f-afc7-7b6cc14b89e0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:17.979896 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-41e9155c-dd8e-4d8f-afc7-7b6cc14b89e0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:18.077501 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-41e9155c-dd8e-4d8f-afc7-7b6cc14b89e0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:18.087870 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-41e9155c-dd8e-4d8f-afc7-7b6cc14b89e0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1094 microversion: 2.1 time: 0.113394 Aug 31 09:52:18.088638 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 219/421] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:17 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1094 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:18.345541 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-0d00f332-817a-4986-a69e-9c903ff43c62 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:18.346014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-0d00f332-817a-4986-a69e-9c903ff43c62 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: 16c07355-b5dd-4e8e-a8bb-e431caacdb59] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:18.355609 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0d00f332-817a-4986-a69e-9c903ff43c62 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:18.356095 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0d00f332-817a-4986-a69e-9c903ff43c62 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:18.356749 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0d00f332-817a-4986-a69e-9c903ff43c62 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:18.358235 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0d00f332-817a-4986-a69e-9c903ff43c62 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:18.358695 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0d00f332-817a-4986-a69e-9c903ff43c62 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:18.359122 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0d00f332-817a-4986-a69e-9c903ff43c62 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:18.523967 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-0d00f332-817a-4986-a69e-9c903ff43c62 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:18.535754 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-0d00f332-817a-4986-a69e-9c903ff43c62 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59" status: 200 len: 1508 microversion: 2.1 time: 0.195305 Aug 31 09:52:18.536965 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 203/422] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:18 2022] GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59 => generated 1508 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:18.620804 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-08c1bfdf-adca-4705-a4ce-cd76f3bb4197 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:18.622090 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-08c1bfdf-adca-4705-a4ce-cd76f3bb4197 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:18.630657 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-08c1bfdf-adca-4705-a4ce-cd76f3bb4197 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:18.631149 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-08c1bfdf-adca-4705-a4ce-cd76f3bb4197 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:18.631576 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-08c1bfdf-adca-4705-a4ce-cd76f3bb4197 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:18.632418 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-08c1bfdf-adca-4705-a4ce-cd76f3bb4197 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:18.632942 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-08c1bfdf-adca-4705-a4ce-cd76f3bb4197 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:18.633356 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-08c1bfdf-adca-4705-a4ce-cd76f3bb4197 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:19.075756 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-08c1bfdf-adca-4705-a4ce-cd76f3bb4197 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:19.088112 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-08c1bfdf-adca-4705-a4ce-cd76f3bb4197 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1258 microversion: 2.1 time: 0.474717 Aug 31 09:52:19.090256 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 220/423] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:18 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1258 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:19.120135 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-12263747-5db7-42b7-9691-e33d5256b182 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:19.122339 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-12263747-5db7-42b7-9691-e33d5256b182 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:19.130018 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-12263747-5db7-42b7-9691-e33d5256b182 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:19.130616 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-12263747-5db7-42b7-9691-e33d5256b182 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:19.131151 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-12263747-5db7-42b7-9691-e33d5256b182 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:19.131968 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-12263747-5db7-42b7-9691-e33d5256b182 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:19.132504 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-12263747-5db7-42b7-9691-e33d5256b182 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:19.132997 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-12263747-5db7-42b7-9691-e33d5256b182 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:19.200251 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-12263747-5db7-42b7-9691-e33d5256b182 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:19.208979 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-12263747-5db7-42b7-9691-e33d5256b182 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1144 microversion: 2.1 time: 0.092910 Aug 31 09:52:19.209644 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 204/424] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:19 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1144 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:20.117293 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f7dbe9f4-b85d-46c3-b33f-008778766b76 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:20.118656 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-f7dbe9f4-b85d-46c3-b33f-008778766b76 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:20.128604 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f7dbe9f4-b85d-46c3-b33f-008778766b76 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:20.129267 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f7dbe9f4-b85d-46c3-b33f-008778766b76 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:20.129902 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f7dbe9f4-b85d-46c3-b33f-008778766b76 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:20.131389 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f7dbe9f4-b85d-46c3-b33f-008778766b76 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:20.132191 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f7dbe9f4-b85d-46c3-b33f-008778766b76 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:20.132763 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f7dbe9f4-b85d-46c3-b33f-008778766b76 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:20.237642 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-2d014ccc-930b-4eac-9129-f63bc400059b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:20.240442 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-2d014ccc-930b-4eac-9129-f63bc400059b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:20.251353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2d014ccc-930b-4eac-9129-f63bc400059b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:20.252229 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2d014ccc-930b-4eac-9129-f63bc400059b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:20.253195 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2d014ccc-930b-4eac-9129-f63bc400059b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:20.254345 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2d014ccc-930b-4eac-9129-f63bc400059b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:20.255156 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2d014ccc-930b-4eac-9129-f63bc400059b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:20.255909 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2d014ccc-930b-4eac-9129-f63bc400059b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:20.381537 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2d014ccc-930b-4eac-9129-f63bc400059b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:20.398950 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-2d014ccc-930b-4eac-9129-f63bc400059b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1192 microversion: 2.1 time: 0.169126 Aug 31 09:52:20.400199 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 205/425] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:20 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1192 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:20.417440 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-f7dbe9f4-b85d-46c3-b33f-008778766b76 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:20.428775 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-f7dbe9f4-b85d-46c3-b33f-008778766b76 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1258 microversion: 2.1 time: 0.321145 Aug 31 09:52:20.429426 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 221/426] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:20 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1258 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:21.440460 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c59fff98-0fd2-4cd0-946b-834712ef1a5b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:21.441837 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c59fff98-0fd2-4cd0-946b-834712ef1a5b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:21.444888 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:21.455828 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c59fff98-0fd2-4cd0-946b-834712ef1a5b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:21.456732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c59fff98-0fd2-4cd0-946b-834712ef1a5b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:21.457025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-70713d51-efde-4fe0-bf59-aae1b499cd3b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:21.457740 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c59fff98-0fd2-4cd0-946b-834712ef1a5b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:21.458258 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-70713d51-efde-4fe0-bf59-aae1b499cd3b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:21.458999 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c59fff98-0fd2-4cd0-946b-834712ef1a5b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:21.460005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c59fff98-0fd2-4cd0-946b-834712ef1a5b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:21.460925 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c59fff98-0fd2-4cd0-946b-834712ef1a5b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:21.468800 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-70713d51-efde-4fe0-bf59-aae1b499cd3b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:21.470093 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-70713d51-efde-4fe0-bf59-aae1b499cd3b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:21.470814 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-70713d51-efde-4fe0-bf59-aae1b499cd3b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:21.472112 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-70713d51-efde-4fe0-bf59-aae1b499cd3b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:21.472884 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-70713d51-efde-4fe0-bf59-aae1b499cd3b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:21.475196 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-70713d51-efde-4fe0-bf59-aae1b499cd3b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:21.611921 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c59fff98-0fd2-4cd0-946b-834712ef1a5b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:21.622411 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c59fff98-0fd2-4cd0-946b-834712ef1a5b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1210 microversion: 2.1 time: 0.188857 Aug 31 09:52:21.630528 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 206/427] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:21 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1210 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:21.707590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-70713d51-efde-4fe0-bf59-aae1b499cd3b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:21.718024 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-70713d51-efde-4fe0-bf59-aae1b499cd3b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1258 microversion: 2.1 time: 0.268815 Aug 31 09:52:21.718278 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 222/428] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:21 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1258 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:22.651257 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9d094c55-dd6d-4192-90a8-775626eae8e5 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:22.651992 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-9d094c55-dd6d-4192-90a8-775626eae8e5 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:22.659371 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9d094c55-dd6d-4192-90a8-775626eae8e5 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:22.659947 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9d094c55-dd6d-4192-90a8-775626eae8e5 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:22.660597 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9d094c55-dd6d-4192-90a8-775626eae8e5 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:22.661308 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9d094c55-dd6d-4192-90a8-775626eae8e5 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:22.661794 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9d094c55-dd6d-4192-90a8-775626eae8e5 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:22.662244 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9d094c55-dd6d-4192-90a8-775626eae8e5 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:22.741585 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b0ec00fb-5063-4729-8d35-9ef231c5db0e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:22.742291 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b0ec00fb-5063-4729-8d35-9ef231c5db0e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:22.745963 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=2 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:22.750984 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b0ec00fb-5063-4729-8d35-9ef231c5db0e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:22.751893 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b0ec00fb-5063-4729-8d35-9ef231c5db0e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:22.752402 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b0ec00fb-5063-4729-8d35-9ef231c5db0e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:22.753178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b0ec00fb-5063-4729-8d35-9ef231c5db0e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:22.753809 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b0ec00fb-5063-4729-8d35-9ef231c5db0e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:22.754365 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b0ec00fb-5063-4729-8d35-9ef231c5db0e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:22.876223 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-9d094c55-dd6d-4192-90a8-775626eae8e5 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:22.884578 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-9d094c55-dd6d-4192-90a8-775626eae8e5 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1266 microversion: 2.1 time: 0.237473 Aug 31 09:52:22.885245 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 207/429] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:22 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:22.889710 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-40a9e5e0-412f-456c-91e3-1a68c73ca2b6 req-fe46984c-b423-4d46-9964-deecb424f86e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb177fd-40cd-4551-be64-eac4c6283268", "tag": "84133d6b-1b23-4f48-ad40-3d788d6effc7"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:22.899668 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-40a9e5e0-412f-456c-91e3-1a68c73ca2b6 req-fe46984c-b423-4d46-9964-deecb424f86e service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:22.900242 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-40a9e5e0-412f-456c-91e3-1a68c73ca2b6 req-fe46984c-b423-4d46-9964-deecb424f86e service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:22.900764 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-40a9e5e0-412f-456c-91e3-1a68c73ca2b6 req-fe46984c-b423-4d46-9964-deecb424f86e service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:22.915184 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-40a9e5e0-412f-456c-91e3-1a68c73ca2b6 req-fe46984c-b423-4d46-9964-deecb424f86e service nova] Creating event network-changed:84133d6b-1b23-4f48-ad40-3d788d6effc7 for instance eeb177fd-40cd-4551-be64-eac4c6283268 on hv-cinder-84496 Aug 31 09:52:22.921223 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-40a9e5e0-412f-456c-91e3-1a68c73ca2b6 req-fe46984c-b423-4d46-9964-deecb424f86e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034106 Aug 31 09:52:22.923017 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 208/430] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:22.945662 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b0ec00fb-5063-4729-8d35-9ef231c5db0e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:22.953640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b0ec00fb-5063-4729-8d35-9ef231c5db0e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1258 microversion: 2.1 time: 0.217716 Aug 31 09:52:22.954563 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 223/431] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:22 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1258 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:23.911551 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-2bb8bb84-4f5d-4b37-8e2d-3e62e36eccd8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:23.912385 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-2bb8bb84-4f5d-4b37-8e2d-3e62e36eccd8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:23.918624 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2bb8bb84-4f5d-4b37-8e2d-3e62e36eccd8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:23.919103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2bb8bb84-4f5d-4b37-8e2d-3e62e36eccd8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:23.919532 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2bb8bb84-4f5d-4b37-8e2d-3e62e36eccd8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:23.920215 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2bb8bb84-4f5d-4b37-8e2d-3e62e36eccd8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:23.920660 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2bb8bb84-4f5d-4b37-8e2d-3e62e36eccd8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:23.921073 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2bb8bb84-4f5d-4b37-8e2d-3e62e36eccd8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:23.975226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-aa1b3e5f-128c-49a6-97bb-f2b0f76ae57f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:23.975829 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-aa1b3e5f-128c-49a6-97bb-f2b0f76ae57f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:23.982673 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-aa1b3e5f-128c-49a6-97bb-f2b0f76ae57f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:23.983157 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-aa1b3e5f-128c-49a6-97bb-f2b0f76ae57f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:23.983813 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-aa1b3e5f-128c-49a6-97bb-f2b0f76ae57f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:23.984875 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-aa1b3e5f-128c-49a6-97bb-f2b0f76ae57f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:23.985975 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-aa1b3e5f-128c-49a6-97bb-f2b0f76ae57f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:23.985975 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-aa1b3e5f-128c-49a6-97bb-f2b0f76ae57f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:24.123090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2bb8bb84-4f5d-4b37-8e2d-3e62e36eccd8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:24.131588 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-2bb8bb84-4f5d-4b37-8e2d-3e62e36eccd8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1266 microversion: 2.1 time: 0.225285 Aug 31 09:52:24.132257 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 209/432] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:23 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:24.157911 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-aa1b3e5f-128c-49a6-97bb-f2b0f76ae57f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:24.165882 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-aa1b3e5f-128c-49a6-97bb-f2b0f76ae57f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1258 microversion: 2.1 time: 0.194537 Aug 31 09:52:24.166376 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 224/433] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:23 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1258 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:25.153600 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-ebdd4a76-5775-4338-86da-1537918d707e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:25.154344 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-ebdd4a76-5775-4338-86da-1537918d707e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:25.164224 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ebdd4a76-5775-4338-86da-1537918d707e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:25.165013 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ebdd4a76-5775-4338-86da-1537918d707e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:25.165585 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ebdd4a76-5775-4338-86da-1537918d707e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:25.166338 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ebdd4a76-5775-4338-86da-1537918d707e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:25.166806 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ebdd4a76-5775-4338-86da-1537918d707e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:25.167220 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ebdd4a76-5775-4338-86da-1537918d707e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:25.186730 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-da38580f-280c-4b25-a322-507e5702d446 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:25.187457 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-da38580f-280c-4b25-a322-507e5702d446 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:25.193655 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-da38580f-280c-4b25-a322-507e5702d446 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:25.194134 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-da38580f-280c-4b25-a322-507e5702d446 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:25.194559 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-da38580f-280c-4b25-a322-507e5702d446 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:25.195247 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-da38580f-280c-4b25-a322-507e5702d446 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:25.195693 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-da38580f-280c-4b25-a322-507e5702d446 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:25.196106 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-da38580f-280c-4b25-a322-507e5702d446 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:25.374407 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-ebdd4a76-5775-4338-86da-1537918d707e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:25.380095 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-da38580f-280c-4b25-a322-507e5702d446 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:25.383144 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-ebdd4a76-5775-4338-86da-1537918d707e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1266 microversion: 2.1 time: 0.233397 Aug 31 09:52:25.383725 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 210/434] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:25 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:25.387671 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-da38580f-280c-4b25-a322-507e5702d446 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1258 microversion: 2.1 time: 0.204804 Aug 31 09:52:25.388227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 225/435] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:25 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1258 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:26.405175 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-97965120-087a-4402-a72a-99af115fb4cd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:26.405874 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-97965120-087a-4402-a72a-99af115fb4cd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:26.409657 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-dc12c8a5-0b8e-4b10-862e-d74eaae17692 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:26.410434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-dc12c8a5-0b8e-4b10-862e-d74eaae17692 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:26.415664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-97965120-087a-4402-a72a-99af115fb4cd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:26.416366 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-97965120-087a-4402-a72a-99af115fb4cd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:26.416501 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-dc12c8a5-0b8e-4b10-862e-d74eaae17692 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:26.416822 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-97965120-087a-4402-a72a-99af115fb4cd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:26.417060 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-dc12c8a5-0b8e-4b10-862e-d74eaae17692 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:26.417581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-97965120-087a-4402-a72a-99af115fb4cd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:26.417768 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-dc12c8a5-0b8e-4b10-862e-d74eaae17692 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:26.418039 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-97965120-087a-4402-a72a-99af115fb4cd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:26.418361 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-dc12c8a5-0b8e-4b10-862e-d74eaae17692 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:26.418533 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-97965120-087a-4402-a72a-99af115fb4cd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:26.418797 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-dc12c8a5-0b8e-4b10-862e-d74eaae17692 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:26.419210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-dc12c8a5-0b8e-4b10-862e-d74eaae17692 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:26.631507 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-dc12c8a5-0b8e-4b10-862e-d74eaae17692 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:26.635125 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-97965120-087a-4402-a72a-99af115fb4cd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:26.639935 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-dc12c8a5-0b8e-4b10-862e-d74eaae17692 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1258 microversion: 2.1 time: 0.235866 Aug 31 09:52:26.640598 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 226/436] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:26 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1258 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:26.644958 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-97965120-087a-4402-a72a-99af115fb4cd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1266 microversion: 2.1 time: 0.243686 Aug 31 09:52:26.645775 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 211/437] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:26 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:27.671139 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b878e230-f40e-4ab0-818d-17cd582cf9aa tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:27.671139 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b878e230-f40e-4ab0-818d-17cd582cf9aa tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:27.671700 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c3dfadc3-7bed-44d6-aed6-01c164cd08bb tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:27.671700 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c3dfadc3-7bed-44d6-aed6-01c164cd08bb tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:27.672791 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b878e230-f40e-4ab0-818d-17cd582cf9aa tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:27.672791 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b878e230-f40e-4ab0-818d-17cd582cf9aa tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:27.672791 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b878e230-f40e-4ab0-818d-17cd582cf9aa tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:27.672791 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b878e230-f40e-4ab0-818d-17cd582cf9aa tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:27.673075 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b878e230-f40e-4ab0-818d-17cd582cf9aa tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:27.673075 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b878e230-f40e-4ab0-818d-17cd582cf9aa tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:27.678111 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c3dfadc3-7bed-44d6-aed6-01c164cd08bb tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:27.678607 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c3dfadc3-7bed-44d6-aed6-01c164cd08bb tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:27.679046 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c3dfadc3-7bed-44d6-aed6-01c164cd08bb tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:27.679752 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c3dfadc3-7bed-44d6-aed6-01c164cd08bb tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:27.680201 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c3dfadc3-7bed-44d6-aed6-01c164cd08bb tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:27.680622 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c3dfadc3-7bed-44d6-aed6-01c164cd08bb tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:27.696745 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=2 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:27.726301 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=6 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:27.886847 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b878e230-f40e-4ab0-818d-17cd582cf9aa tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:27.896178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b878e230-f40e-4ab0-818d-17cd582cf9aa tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1258 microversion: 2.1 time: 0.239334 Aug 31 09:52:27.896764 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 227/438] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:27 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1258 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:27.909456 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c3dfadc3-7bed-44d6-aed6-01c164cd08bb tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:27.917330 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c3dfadc3-7bed-44d6-aed6-01c164cd08bb tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1266 microversion: 2.1 time: 0.254578 Aug 31 09:52:27.917931 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 212/439] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:27 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:28.919194 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-fb21856c-7193-4606-80f7-383885158293 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:28.919750 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-fb21856c-7193-4606-80f7-383885158293 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:28.923875 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=10 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:28.930343 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fb21856c-7193-4606-80f7-383885158293 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:28.930826 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fb21856c-7193-4606-80f7-383885158293 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:28.931253 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fb21856c-7193-4606-80f7-383885158293 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:28.931950 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fb21856c-7193-4606-80f7-383885158293 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:28.932396 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fb21856c-7193-4606-80f7-383885158293 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:28.932849 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fb21856c-7193-4606-80f7-383885158293 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:28.940456 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-be398162-c9b5-442d-b18f-5ddde032f0fd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:28.941126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-be398162-c9b5-442d-b18f-5ddde032f0fd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:28.947910 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be398162-c9b5-442d-b18f-5ddde032f0fd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:28.948397 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be398162-c9b5-442d-b18f-5ddde032f0fd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:28.948827 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be398162-c9b5-442d-b18f-5ddde032f0fd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:28.949607 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be398162-c9b5-442d-b18f-5ddde032f0fd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:28.950057 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be398162-c9b5-442d-b18f-5ddde032f0fd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:28.950476 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be398162-c9b5-442d-b18f-5ddde032f0fd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:29.199767 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-fb21856c-7193-4606-80f7-383885158293 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:29.203376 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-be398162-c9b5-442d-b18f-5ddde032f0fd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:29.209653 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-fb21856c-7193-4606-80f7-383885158293 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1258 microversion: 2.1 time: 0.294611 Aug 31 09:52:29.215291 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 228/440] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:28 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1258 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:29.218914 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-be398162-c9b5-442d-b18f-5ddde032f0fd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1266 microversion: 2.1 time: 0.283221 Aug 31 09:52:29.219892 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 213/441] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:28 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:30.230510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-da00488f-241c-4024-affb-e6c81a8d1450 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:30.231108 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-da00488f-241c-4024-affb-e6c81a8d1450 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:30.232945 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:30.240829 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-da00488f-241c-4024-affb-e6c81a8d1450 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:30.242586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-da00488f-241c-4024-affb-e6c81a8d1450 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:30.242586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-da00488f-241c-4024-affb-e6c81a8d1450 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:30.242586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-da00488f-241c-4024-affb-e6c81a8d1450 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:30.242863 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-da00488f-241c-4024-affb-e6c81a8d1450 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:30.243271 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-da00488f-241c-4024-affb-e6c81a8d1450 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:30.248188 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-4610ba91-39c9-41bb-810b-f54e94c60f94 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:30.248800 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-4610ba91-39c9-41bb-810b-f54e94c60f94 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:30.255554 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4610ba91-39c9-41bb-810b-f54e94c60f94 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:30.256038 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4610ba91-39c9-41bb-810b-f54e94c60f94 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:30.256468 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4610ba91-39c9-41bb-810b-f54e94c60f94 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:30.257167 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4610ba91-39c9-41bb-810b-f54e94c60f94 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:30.257726 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4610ba91-39c9-41bb-810b-f54e94c60f94 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:30.258420 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4610ba91-39c9-41bb-810b-f54e94c60f94 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:30.464398 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-da00488f-241c-4024-affb-e6c81a8d1450 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:30.479773 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-da00488f-241c-4024-affb-e6c81a8d1450 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1258 microversion: 2.1 time: 0.252655 Aug 31 09:52:30.480860 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 229/442] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:30 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1258 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:30.513358 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-4610ba91-39c9-41bb-810b-f54e94c60f94 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:30.522320 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-4610ba91-39c9-41bb-810b-f54e94c60f94 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1266 microversion: 2.1 time: 0.278213 Aug 31 09:52:30.523184 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 214/443] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:30 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1266 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:30.792224 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-41aaf3f2-0412-4c84-897c-c810a54d39f3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:30.792783 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-41aaf3f2-0412-4c84-897c-c810a54d39f3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:30.803586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-41aaf3f2-0412-4c84-897c-c810a54d39f3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:30.803586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-41aaf3f2-0412-4c84-897c-c810a54d39f3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:30.803586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-41aaf3f2-0412-4c84-897c-c810a54d39f3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:30.803586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-41aaf3f2-0412-4c84-897c-c810a54d39f3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:30.804010 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-41aaf3f2-0412-4c84-897c-c810a54d39f3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:30.804010 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-41aaf3f2-0412-4c84-897c-c810a54d39f3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:30.838864 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-41aaf3f2-0412-4c84-897c-c810a54d39f3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3/ips" status: 200 len: 149 microversion: 2.1 time: 0.052537 Aug 31 09:52:30.839746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 230/444] 10.222.0.13 () {58 vars in 1248 bytes} [Wed Aug 31 09:52:30 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3/ips => generated 149 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:30.941960 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-d5f27d57-4038-49b1-8f96-7e3d45c7d09c req-bdde46c3-80d2-4704-b80b-330c95b77c6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b32c74c-ed7a-496f-bf84-ce2d50e8b808", "name": "network-vif-plugged", "status": "completed", "tag": "a4adc3c8-d787-4f05-8cd2-ace7305b75c0"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:30.958369 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-d5f27d57-4038-49b1-8f96-7e3d45c7d09c req-bdde46c3-80d2-4704-b80b-330c95b77c6b service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:30.959586 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-d5f27d57-4038-49b1-8f96-7e3d45c7d09c req-bdde46c3-80d2-4704-b80b-330c95b77c6b service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:30.960726 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-d5f27d57-4038-49b1-8f96-7e3d45c7d09c req-bdde46c3-80d2-4704-b80b-330c95b77c6b service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:30.987342 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-d5f27d57-4038-49b1-8f96-7e3d45c7d09c req-bdde46c3-80d2-4704-b80b-330c95b77c6b service nova] Creating event network-vif-plugged:a4adc3c8-d787-4f05-8cd2-ace7305b75c0 for instance 1b32c74c-ed7a-496f-bf84-ce2d50e8b808 on hv-cinder-84496 Aug 31 09:52:30.994442 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-d5f27d57-4038-49b1-8f96-7e3d45c7d09c req-bdde46c3-80d2-4704-b80b-330c95b77c6b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057392 Aug 31 09:52:30.995882 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 215/445] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:31.506845 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-c8ad9c43-c160-4017-8074-550c5e4de9cd tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:31.508004 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-c8ad9c43-c160-4017-8074-550c5e4de9cd tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:31.520194 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8ad9c43-c160-4017-8074-550c5e4de9cd tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:31.520951 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8ad9c43-c160-4017-8074-550c5e4de9cd tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:31.521774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8ad9c43-c160-4017-8074-550c5e4de9cd tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:31.523090 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8ad9c43-c160-4017-8074-550c5e4de9cd tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:31.523926 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8ad9c43-c160-4017-8074-550c5e4de9cd tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:31.524716 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8ad9c43-c160-4017-8074-550c5e4de9cd tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:31.545082 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-b91e3de0-5830-4606-9cde-a81528ac7de8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:31.546034 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-b91e3de0-5830-4606-9cde-a81528ac7de8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:31.552984 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b91e3de0-5830-4606-9cde-a81528ac7de8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:31.553515 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b91e3de0-5830-4606-9cde-a81528ac7de8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:31.553958 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b91e3de0-5830-4606-9cde-a81528ac7de8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:31.554662 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b91e3de0-5830-4606-9cde-a81528ac7de8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:31.555116 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b91e3de0-5830-4606-9cde-a81528ac7de8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:31.555624 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b91e3de0-5830-4606-9cde-a81528ac7de8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:31.560638 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=100 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:31.756770 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-c8ad9c43-c160-4017-8074-550c5e4de9cd tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:31.765367 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-c8ad9c43-c160-4017-8074-550c5e4de9cd tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1258 microversion: 2.1 time: 0.265910 Aug 31 09:52:31.773865 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 231/446] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:31 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1258 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:31.776168 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b91e3de0-5830-4606-9cde-a81528ac7de8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:31.784816 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-b91e3de0-5830-4606-9cde-a81528ac7de8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1266 microversion: 2.1 time: 0.244496 Aug 31 09:52:31.785478 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 216/447] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:31 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:32.326470 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-c500aa90-8b1b-409f-957b-32f65c75f533 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca3487c4-dad6-48ff-991c-23ed1c520b99"}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:32.329643 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-c500aa90-8b1b-409f-957b-32f65c75f533 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:32.336057 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c500aa90-8b1b-409f-957b-32f65c75f533 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:32.336683 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c500aa90-8b1b-409f-957b-32f65c75f533 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:32.337239 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c500aa90-8b1b-409f-957b-32f65c75f533 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:32.338338 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c500aa90-8b1b-409f-957b-32f65c75f533 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:32.339274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c500aa90-8b1b-409f-957b-32f65c75f533 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:32.339961 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c500aa90-8b1b-409f-957b-32f65c75f533 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:32.787760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-5c2c2f02-7f09-4fb3-87c0-81d30bbe809a tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:32.788490 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-5c2c2f02-7f09-4fb3-87c0-81d30bbe809a tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:32.794758 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5c2c2f02-7f09-4fb3-87c0-81d30bbe809a tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:32.795245 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5c2c2f02-7f09-4fb3-87c0-81d30bbe809a tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:32.795688 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5c2c2f02-7f09-4fb3-87c0-81d30bbe809a tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:32.796385 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5c2c2f02-7f09-4fb3-87c0-81d30bbe809a tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:32.797539 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5c2c2f02-7f09-4fb3-87c0-81d30bbe809a tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:32.798236 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5c2c2f02-7f09-4fb3-87c0-81d30bbe809a tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:32.971756 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-5c2c2f02-7f09-4fb3-87c0-81d30bbe809a tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:32.980712 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-5c2c2f02-7f09-4fb3-87c0-81d30bbe809a tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1258 microversion: 2.1 time: 0.197348 Aug 31 09:52:32.981336 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 217/448] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:32 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1258 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:32.987879 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-cdb3992d-d552-4968-9e2f-406f8c06aefe tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:32.988960 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-cdb3992d-d552-4968-9e2f-406f8c06aefe tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:32.996611 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cdb3992d-d552-4968-9e2f-406f8c06aefe tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:32.997099 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cdb3992d-d552-4968-9e2f-406f8c06aefe tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:32.997750 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cdb3992d-d552-4968-9e2f-406f8c06aefe tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:32.998554 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cdb3992d-d552-4968-9e2f-406f8c06aefe tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:32.999034 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cdb3992d-d552-4968-9e2f-406f8c06aefe tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:32.999452 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cdb3992d-d552-4968-9e2f-406f8c06aefe tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:33.166047 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-cdb3992d-d552-4968-9e2f-406f8c06aefe tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:33.174057 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-cdb3992d-d552-4968-9e2f-406f8c06aefe tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1266 microversion: 2.1 time: 0.191631 Aug 31 09:52:33.174640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 218/449] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:32 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:34.005155 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-6d7b83c5-cb78-4fa3-95dc-e65aaadcec6f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:34.006226 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-6d7b83c5-cb78-4fa3-95dc-e65aaadcec6f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:34.016343 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6d7b83c5-cb78-4fa3-95dc-e65aaadcec6f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:34.017160 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6d7b83c5-cb78-4fa3-95dc-e65aaadcec6f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:34.017902 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6d7b83c5-cb78-4fa3-95dc-e65aaadcec6f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:34.019058 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6d7b83c5-cb78-4fa3-95dc-e65aaadcec6f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:34.019806 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6d7b83c5-cb78-4fa3-95dc-e65aaadcec6f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:34.020491 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6d7b83c5-cb78-4fa3-95dc-e65aaadcec6f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:34.206749 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-6d7b83c5-cb78-4fa3-95dc-e65aaadcec6f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:34.214483 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-6d7b83c5-cb78-4fa3-95dc-e65aaadcec6f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1258 microversion: 2.1 time: 0.215924 Aug 31 09:52:34.215052 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 219/450] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:33 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1258 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:34.221164 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-4fef4d71-0ad0-478d-a661-05df6f212c2b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:34.221965 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-4fef4d71-0ad0-478d-a661-05df6f212c2b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:34.229175 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4fef4d71-0ad0-478d-a661-05df6f212c2b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:34.229589 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4fef4d71-0ad0-478d-a661-05df6f212c2b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:34.230022 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4fef4d71-0ad0-478d-a661-05df6f212c2b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:34.230716 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4fef4d71-0ad0-478d-a661-05df6f212c2b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:34.231160 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4fef4d71-0ad0-478d-a661-05df6f212c2b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:34.231573 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4fef4d71-0ad0-478d-a661-05df6f212c2b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:34.381152 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-4fef4d71-0ad0-478d-a661-05df6f212c2b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:34.388920 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-4fef4d71-0ad0-478d-a661-05df6f212c2b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1266 microversion: 2.1 time: 0.172930 Aug 31 09:52:34.389514 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 220/451] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:34 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:35.236923 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-638c82d3-ea1b-4c01-98b9-9dc6c665fa35 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:35.237707 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-638c82d3-ea1b-4c01-98b9-9dc6c665fa35 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:35.244164 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-638c82d3-ea1b-4c01-98b9-9dc6c665fa35 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:35.244664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-638c82d3-ea1b-4c01-98b9-9dc6c665fa35 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:35.245072 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-638c82d3-ea1b-4c01-98b9-9dc6c665fa35 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:35.245808 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-638c82d3-ea1b-4c01-98b9-9dc6c665fa35 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:35.246521 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-638c82d3-ea1b-4c01-98b9-9dc6c665fa35 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:35.246937 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-638c82d3-ea1b-4c01-98b9-9dc6c665fa35 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:35.401255 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-638c82d3-ea1b-4c01-98b9-9dc6c665fa35 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:35.412895 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-638c82d3-ea1b-4c01-98b9-9dc6c665fa35 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1441 microversion: 2.1 time: 0.180693 Aug 31 09:52:35.413769 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 221/452] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:35 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1441 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:35.418386 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-f2038cc9-05e1-4575-9ca5-11d6779ec503 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:35.419005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-f2038cc9-05e1-4575-9ca5-11d6779ec503 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:35.426572 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f2038cc9-05e1-4575-9ca5-11d6779ec503 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:35.427072 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f2038cc9-05e1-4575-9ca5-11d6779ec503 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:35.427515 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f2038cc9-05e1-4575-9ca5-11d6779ec503 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:35.428225 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f2038cc9-05e1-4575-9ca5-11d6779ec503 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:35.428682 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f2038cc9-05e1-4575-9ca5-11d6779ec503 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:35.429106 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f2038cc9-05e1-4575-9ca5-11d6779ec503 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:35.582973 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-f2038cc9-05e1-4575-9ca5-11d6779ec503 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:35.591830 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-f2038cc9-05e1-4575-9ca5-11d6779ec503 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1266 microversion: 2.1 time: 0.177096 Aug 31 09:52:35.592417 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 222/453] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:35 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:35.600425 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-687d837e-09ae-4a45-92f5-39a4e5c269c2 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:35.601653 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-687d837e-09ae-4a45-92f5-39a4e5c269c2 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:35.611000 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-687d837e-09ae-4a45-92f5-39a4e5c269c2 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:35.611486 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-687d837e-09ae-4a45-92f5-39a4e5c269c2 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:35.611917 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-687d837e-09ae-4a45-92f5-39a4e5c269c2 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:35.612623 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-687d837e-09ae-4a45-92f5-39a4e5c269c2 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:35.613070 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-687d837e-09ae-4a45-92f5-39a4e5c269c2 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:35.613514 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-687d837e-09ae-4a45-92f5-39a4e5c269c2 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:35.682277 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-c500aa90-8b1b-409f-957b-32f65c75f533 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "POST /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.359585 Aug 31 09:52:35.682985 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 232/454] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 31 09:52:32 2022] POST /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3/os-volume_attachments => generated 194 bytes in 3361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:52:35.774039 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-687d837e-09ae-4a45-92f5-39a4e5c269c2 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:35.783054 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-687d837e-09ae-4a45-92f5-39a4e5c269c2 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1441 microversion: 2.1 time: 0.189424 Aug 31 09:52:35.783657 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 223/455] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:35 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1441 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:36.616701 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-14b38c78-1a62-4dee-b990-2447f0ce951d tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:36.617313 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-14b38c78-1a62-4dee-b990-2447f0ce951d tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:36.624253 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-14b38c78-1a62-4dee-b990-2447f0ce951d tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:36.625301 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-14b38c78-1a62-4dee-b990-2447f0ce951d tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:36.625935 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-14b38c78-1a62-4dee-b990-2447f0ce951d tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:36.626855 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-14b38c78-1a62-4dee-b990-2447f0ce951d tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:36.627312 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-14b38c78-1a62-4dee-b990-2447f0ce951d tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:36.627733 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-14b38c78-1a62-4dee-b990-2447f0ce951d tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:36.793762 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-14b38c78-1a62-4dee-b990-2447f0ce951d tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:36.803663 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-14b38c78-1a62-4dee-b990-2447f0ce951d tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1266 microversion: 2.1 time: 0.191851 Aug 31 09:52:36.804240 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 233/456] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:36 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:37.829887 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-377adc08-2d1a-4264-84ba-525f7f719b25 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:37.831894 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-377adc08-2d1a-4264-84ba-525f7f719b25 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:37.843192 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-377adc08-2d1a-4264-84ba-525f7f719b25 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:37.844645 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-377adc08-2d1a-4264-84ba-525f7f719b25 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:37.845647 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-377adc08-2d1a-4264-84ba-525f7f719b25 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:37.848157 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-377adc08-2d1a-4264-84ba-525f7f719b25 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:37.849021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-377adc08-2d1a-4264-84ba-525f7f719b25 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:37.849967 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-377adc08-2d1a-4264-84ba-525f7f719b25 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:38.036799 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-377adc08-2d1a-4264-84ba-525f7f719b25 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:38.044520 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-31a0b01a-8907-43db-8209-b53a71aadc4b req-816dd57d-4d66-4bb1-920d-488cf704beda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b32c74c-ed7a-496f-bf84-ce2d50e8b808", "tag": "a4adc3c8-d787-4f05-8cd2-ace7305b75c0"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:38.054059 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-377adc08-2d1a-4264-84ba-525f7f719b25 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1266 microversion: 2.1 time: 0.233017 Aug 31 09:52:38.054662 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 224/457] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:37 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:38.061403 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-31a0b01a-8907-43db-8209-b53a71aadc4b req-816dd57d-4d66-4bb1-920d-488cf704beda service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:38.061887 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-31a0b01a-8907-43db-8209-b53a71aadc4b req-816dd57d-4d66-4bb1-920d-488cf704beda service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:38.062624 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-31a0b01a-8907-43db-8209-b53a71aadc4b req-816dd57d-4d66-4bb1-920d-488cf704beda service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:38.075383 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-31a0b01a-8907-43db-8209-b53a71aadc4b req-816dd57d-4d66-4bb1-920d-488cf704beda service nova] Creating event network-changed:a4adc3c8-d787-4f05-8cd2-ace7305b75c0 for instance 1b32c74c-ed7a-496f-bf84-ce2d50e8b808 on hv-cinder-84496 Aug 31 09:52:38.083528 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-31a0b01a-8907-43db-8209-b53a71aadc4b req-816dd57d-4d66-4bb1-920d-488cf704beda service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042562 Aug 31 09:52:38.084153 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 234/458] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:39.087646 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-90c279c3-6f61-438e-9ffd-57a55ffb4451 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:39.088670 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-90c279c3-6f61-438e-9ffd-57a55ffb4451 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:39.096443 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-90c279c3-6f61-438e-9ffd-57a55ffb4451 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:39.096928 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-90c279c3-6f61-438e-9ffd-57a55ffb4451 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:39.097357 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-90c279c3-6f61-438e-9ffd-57a55ffb4451 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:39.098203 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-90c279c3-6f61-438e-9ffd-57a55ffb4451 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:39.098648 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-90c279c3-6f61-438e-9ffd-57a55ffb4451 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:39.099069 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-90c279c3-6f61-438e-9ffd-57a55ffb4451 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:39.234954 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-90c279c3-6f61-438e-9ffd-57a55ffb4451 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:39.242858 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-90c279c3-6f61-438e-9ffd-57a55ffb4451 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1266 microversion: 2.1 time: 0.160340 Aug 31 09:52:39.243442 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 225/459] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:39 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:39.827518 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-f3bbb700-60f3-4f62-9318-42ad124de40c req-67adf2b3-ee38-4f19-a897-7a3a80f71c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb177fd-40cd-4551-be64-eac4c6283268", "name": "network-vif-plugged", "status": "completed", "tag": "84133d6b-1b23-4f48-ad40-3d788d6effc7"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:39.838798 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-f3bbb700-60f3-4f62-9318-42ad124de40c req-67adf2b3-ee38-4f19-a897-7a3a80f71c14 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:39.839280 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-f3bbb700-60f3-4f62-9318-42ad124de40c req-67adf2b3-ee38-4f19-a897-7a3a80f71c14 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:39.839717 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-f3bbb700-60f3-4f62-9318-42ad124de40c req-67adf2b3-ee38-4f19-a897-7a3a80f71c14 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:39.853259 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-f3bbb700-60f3-4f62-9318-42ad124de40c req-67adf2b3-ee38-4f19-a897-7a3a80f71c14 service nova] Creating event network-vif-plugged:84133d6b-1b23-4f48-ad40-3d788d6effc7 for instance eeb177fd-40cd-4551-be64-eac4c6283268 on hv-cinder-84496 Aug 31 09:52:39.858278 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-f3bbb700-60f3-4f62-9318-42ad124de40c req-67adf2b3-ee38-4f19-a897-7a3a80f71c14 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035360 Aug 31 09:52:39.858923 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 235/460] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:40.265835 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-ff0807b9-b1f9-479e-b2f3-c3b54e354742 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:40.266471 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-ff0807b9-b1f9-479e-b2f3-c3b54e354742 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:40.273820 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ff0807b9-b1f9-479e-b2f3-c3b54e354742 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:40.274313 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ff0807b9-b1f9-479e-b2f3-c3b54e354742 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:40.274745 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ff0807b9-b1f9-479e-b2f3-c3b54e354742 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:40.275440 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ff0807b9-b1f9-479e-b2f3-c3b54e354742 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:40.276010 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ff0807b9-b1f9-479e-b2f3-c3b54e354742 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:40.276433 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ff0807b9-b1f9-479e-b2f3-c3b54e354742 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:40.423826 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-ff0807b9-b1f9-479e-b2f3-c3b54e354742 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:40.431660 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-ff0807b9-b1f9-479e-b2f3-c3b54e354742 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1266 microversion: 2.1 time: 0.170529 Aug 31 09:52:40.432245 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 226/461] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:40 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:41.456015 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b5e6d0d7-d340-413e-9a16-805912db64f4 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:41.456887 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b5e6d0d7-d340-413e-9a16-805912db64f4 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:41.463136 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b5e6d0d7-d340-413e-9a16-805912db64f4 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:41.463620 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b5e6d0d7-d340-413e-9a16-805912db64f4 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:41.464051 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b5e6d0d7-d340-413e-9a16-805912db64f4 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:41.464743 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b5e6d0d7-d340-413e-9a16-805912db64f4 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:41.465191 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b5e6d0d7-d340-413e-9a16-805912db64f4 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:41.465636 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b5e6d0d7-d340-413e-9a16-805912db64f4 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:41.485692 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:41.619359 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b5e6d0d7-d340-413e-9a16-805912db64f4 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:41.630593 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b5e6d0d7-d340-413e-9a16-805912db64f4 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1266 microversion: 2.1 time: 0.180569 Aug 31 09:52:41.631166 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 236/462] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:41 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:42.651745 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-b4e65134-be92-45a7-9087-8b66175e80e0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:42.652432 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-b4e65134-be92-45a7-9087-8b66175e80e0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:42.659772 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b4e65134-be92-45a7-9087-8b66175e80e0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:42.660255 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b4e65134-be92-45a7-9087-8b66175e80e0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:42.660688 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b4e65134-be92-45a7-9087-8b66175e80e0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:42.661407 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b4e65134-be92-45a7-9087-8b66175e80e0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:42.661851 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b4e65134-be92-45a7-9087-8b66175e80e0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:42.662318 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b4e65134-be92-45a7-9087-8b66175e80e0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:42.809979 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b4e65134-be92-45a7-9087-8b66175e80e0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:42.818280 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-b4e65134-be92-45a7-9087-8b66175e80e0 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1451 microversion: 2.1 time: 0.170310 Aug 31 09:52:42.818874 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 227/463] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:42 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1451 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:42.840822 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-3d5b70b0-ccf9-4d3d-beed-bce758e22038 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:42.841547 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-3d5b70b0-ccf9-4d3d-beed-bce758e22038 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:42.849202 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3d5b70b0-ccf9-4d3d-beed-bce758e22038 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:42.849720 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3d5b70b0-ccf9-4d3d-beed-bce758e22038 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:42.850146 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3d5b70b0-ccf9-4d3d-beed-bce758e22038 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:42.850838 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3d5b70b0-ccf9-4d3d-beed-bce758e22038 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:42.851277 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3d5b70b0-ccf9-4d3d-beed-bce758e22038 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:42.851686 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3d5b70b0-ccf9-4d3d-beed-bce758e22038 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:42.997084 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-3d5b70b0-ccf9-4d3d-beed-bce758e22038 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:43.005131 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-3d5b70b0-ccf9-4d3d-beed-bce758e22038 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1451 microversion: 2.1 time: 0.168298 Aug 31 09:52:43.005747 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 237/464] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:42 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1451 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:44.866685 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-3eb98de2-1c82-4964-9064-696b11715bba req-ad22054d-ba8e-47d8-a377-885773ad16a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb177fd-40cd-4551-be64-eac4c6283268", "tag": "84133d6b-1b23-4f48-ad40-3d788d6effc7"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:44.885184 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-3eb98de2-1c82-4964-9064-696b11715bba req-ad22054d-ba8e-47d8-a377-885773ad16a3 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:44.886083 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-3eb98de2-1c82-4964-9064-696b11715bba req-ad22054d-ba8e-47d8-a377-885773ad16a3 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:44.886844 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-3eb98de2-1c82-4964-9064-696b11715bba req-ad22054d-ba8e-47d8-a377-885773ad16a3 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:44.908972 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-3eb98de2-1c82-4964-9064-696b11715bba req-ad22054d-ba8e-47d8-a377-885773ad16a3 service nova] Creating event network-changed:84133d6b-1b23-4f48-ad40-3d788d6effc7 for instance eeb177fd-40cd-4551-be64-eac4c6283268 on hv-cinder-84496 Aug 31 09:52:44.914291 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-3eb98de2-1c82-4964-9064-696b11715bba req-ad22054d-ba8e-47d8-a377-885773ad16a3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055169 Aug 31 09:52:44.914911 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 228/465] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:45.531624 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-0cd5e651-eab5-4a6c-abc2-b49aea8d842d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Action: 'create', calling method: .version_select at 0x7f5503e841f0>, body: {"keypair": {"name": "tempest-keypair-288177047", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeMsbvlmFt83wbP6CP/uObdAfMEVJijG8QdGMGnmOkHKLDO1Xpt0mnSO9GgekJLkYRHHEVXjEnWhfS8LADsAzjsJcnlrSnCP+x6UphR0LcK2LDnEM1x1cqKbUXJVnVixQ=="}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:45.552134 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-0cd5e651-eab5-4a6c-abc2-b49aea8d842d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Getting quotas for project 5ed9143757584694a5139ada8dbd5570. Resources: {'key_pairs'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:52:45.556531 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-0cd5e651-eab5-4a6c-abc2-b49aea8d842d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Getting quotas for user 25b4233e5f0e41bf99b3fb3f5f6229c9 and project 5ed9143757584694a5139ada8dbd5570. Resources: {'key_pairs'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:52:45.581835 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-0cd5e651-eab5-4a6c-abc2-b49aea8d842d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056367 Aug 31 09:52:45.582456 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 238/466] 10.222.0.13 () {60 vars in 1159 bytes} [Wed Aug 31 09:52:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:46.877701 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-64cb8518-ae91-4c06-8e34-e9ea5857fdc8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbb010b3-4d48-4bf9-b6c4-3e9315d4457e", "device": "/dev/sdb"}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:46.880645 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-64cb8518-ae91-4c06-8e34-e9ea5857fdc8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: 16c07355-b5dd-4e8e-a8bb-e431caacdb59] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:46.887516 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-64cb8518-ae91-4c06-8e34-e9ea5857fdc8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:46.887993 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-64cb8518-ae91-4c06-8e34-e9ea5857fdc8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:46.888419 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-64cb8518-ae91-4c06-8e34-e9ea5857fdc8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:46.889132 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-64cb8518-ae91-4c06-8e34-e9ea5857fdc8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:46.889600 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-64cb8518-ae91-4c06-8e34-e9ea5857fdc8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:46.890185 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-64cb8518-ae91-4c06-8e34-e9ea5857fdc8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:47.342135 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-7ddc0c08-8ed8-4733-a9bc-8611e82f0e82 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1493716627", "imageRef": "8e078bb9-f274-4984-8128-d31407d49604", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ba3d70db-89a3-4a36-91f7-576971d6cd3f"}], "security_groups": [{"name": "tempest-securitygroup--1152951319"}], "key_name": "tempest-keypair-288177047", "user_data": "}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:47.387879 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-64cb8518-ae91-4c06-8e34-e9ea5857fdc8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "POST /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.514934 Aug 31 09:52:47.388510 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 229/467] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 31 09:52:46 2022] POST /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59/os-volume_attachments => generated 194 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:47.611937 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.network.neutron [None req-7ddc0c08-8ed8-4733-a9bc-8611e82f0e82 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] validate_networks() for [('ba3d70db-89a3-4a36-91f7-576971d6cd3f', None, None, None, None, None)] {{(pid=127170) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:52:48.020857 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-7ddc0c08-8ed8-4733-a9bc-8611e82f0e82 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Flavor limits 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:52:48.021299 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-7ddc0c08-8ed8-4733-a9bc-8611e82f0e82 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Image limits 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:52:48.021802 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-7ddc0c08-8ed8-4733-a9bc-8611e82f0e82 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Flavor pref 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:52:48.022211 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-7ddc0c08-8ed8-4733-a9bc-8611e82f0e82 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Image pref 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:52:48.022611 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-7ddc0c08-8ed8-4733-a9bc-8611e82f0e82 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:52:48.032690 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7ddc0c08-8ed8-4733-a9bc-8611e82f0e82 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:48.033167 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7ddc0c08-8ed8-4733-a9bc-8611e82f0e82 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:48.033631 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7ddc0c08-8ed8-4733-a9bc-8611e82f0e82 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:48.034350 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7ddc0c08-8ed8-4733-a9bc-8611e82f0e82 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:48.034801 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7ddc0c08-8ed8-4733-a9bc-8611e82f0e82 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:48.035241 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7ddc0c08-8ed8-4733-a9bc-8611e82f0e82 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:48.055620 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-7ddc0c08-8ed8-4733-a9bc-8611e82f0e82 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Getting quotas for project 5ed9143757584694a5139ada8dbd5570. Resources: {'ram', 'instances', 'cores'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:52:48.061376 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-7ddc0c08-8ed8-4733-a9bc-8611e82f0e82 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Getting quotas for user 25b4233e5f0e41bf99b3fb3f5f6229c9 and project 5ed9143757584694a5139ada8dbd5570. Resources: {'ram', 'instances', 'cores'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:52:48.073874 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-7ddc0c08-8ed8-4733-a9bc-8611e82f0e82 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Going to run 1 instances... {{(pid=127170) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:52:48.076227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-7ddc0c08-8ed8-4733-a9bc-8611e82f0e82 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8e078bb9-f274-4984-8128-d31407d49604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:52:48.128164 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-7ddc0c08-8ed8-4733-a9bc-8611e82f0e82 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.790660 Aug 31 09:52:48.132955 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 239/468] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 31 09:52:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 09:52:48.141614 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-2fece922-6fe5-419a-b0fb-14f7425a0298 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:48.142359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-2fece922-6fe5-419a-b0fb-14f7425a0298 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:48.203426 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2fece922-6fe5-419a-b0fb-14f7425a0298 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:48.210803 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-2fece922-6fe5-419a-b0fb-14f7425a0298 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 200 len: 1241 microversion: 2.1 time: 0.074577 Aug 31 09:52:48.211921 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 230/469] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:48 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:49.235828 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-d8f8f025-4f15-4dcb-a659-a80e33725486 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:49.236445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-d8f8f025-4f15-4dcb-a659-a80e33725486 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:49.243711 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d8f8f025-4f15-4dcb-a659-a80e33725486 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:49.244196 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d8f8f025-4f15-4dcb-a659-a80e33725486 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:49.244624 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d8f8f025-4f15-4dcb-a659-a80e33725486 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:49.245319 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d8f8f025-4f15-4dcb-a659-a80e33725486 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:49.246060 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d8f8f025-4f15-4dcb-a659-a80e33725486 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:49.246475 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d8f8f025-4f15-4dcb-a659-a80e33725486 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:49.315652 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-d8f8f025-4f15-4dcb-a659-a80e33725486 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:49.325910 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-d8f8f025-4f15-4dcb-a659-a80e33725486 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 200 len: 1293 microversion: 2.1 time: 0.095728 Aug 31 09:52:49.326484 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 240/470] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:49 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:50.349043 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9b284ab1-925e-48f6-8684-5da3ded17657 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:50.349684 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-9b284ab1-925e-48f6-8684-5da3ded17657 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:50.358587 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9b284ab1-925e-48f6-8684-5da3ded17657 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:50.358587 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9b284ab1-925e-48f6-8684-5da3ded17657 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:50.358587 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9b284ab1-925e-48f6-8684-5da3ded17657 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:50.359486 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9b284ab1-925e-48f6-8684-5da3ded17657 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:50.360137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9b284ab1-925e-48f6-8684-5da3ded17657 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:50.360562 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9b284ab1-925e-48f6-8684-5da3ded17657 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:50.426446 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-9b284ab1-925e-48f6-8684-5da3ded17657 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:50.435463 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-9b284ab1-925e-48f6-8684-5da3ded17657 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 200 len: 1299 microversion: 2.1 time: 0.090266 Aug 31 09:52:50.436260 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 231/471] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:50 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:51.389710 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-3a2f63d3-a977-4aea-8613-6ce1ad471ba5 req-f9420fed-a5a9-4aca-9356-35dd83ed8746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f64ad4a-cdde-4c1e-ac02-3977cdadef31", "tag": "f6f8c737-1493-4a89-b98d-7b911611cfc5"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:51.409209 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-3a2f63d3-a977-4aea-8613-6ce1ad471ba5 req-f9420fed-a5a9-4aca-9356-35dd83ed8746 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:51.410136 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-3a2f63d3-a977-4aea-8613-6ce1ad471ba5 req-f9420fed-a5a9-4aca-9356-35dd83ed8746 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:51.410914 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-3a2f63d3-a977-4aea-8613-6ce1ad471ba5 req-f9420fed-a5a9-4aca-9356-35dd83ed8746 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:51.432833 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-3a2f63d3-a977-4aea-8613-6ce1ad471ba5 req-f9420fed-a5a9-4aca-9356-35dd83ed8746 service nova] Creating event network-changed:f6f8c737-1493-4a89-b98d-7b911611cfc5 for instance 2f64ad4a-cdde-4c1e-ac02-3977cdadef31 on hv-cinder-84496 Aug 31 09:52:51.442140 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-3a2f63d3-a977-4aea-8613-6ce1ad471ba5 req-f9420fed-a5a9-4aca-9356-35dd83ed8746 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057239 Aug 31 09:52:51.443148 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 241/472] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:51.458730 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-2f527ee8-cbef-4b48-b2f1-1e08c38581d5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:51.459342 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-2f527ee8-cbef-4b48-b2f1-1e08c38581d5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:51.466568 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2f527ee8-cbef-4b48-b2f1-1e08c38581d5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:51.467056 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2f527ee8-cbef-4b48-b2f1-1e08c38581d5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:51.467501 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2f527ee8-cbef-4b48-b2f1-1e08c38581d5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:51.468337 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2f527ee8-cbef-4b48-b2f1-1e08c38581d5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:51.468861 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2f527ee8-cbef-4b48-b2f1-1e08c38581d5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:51.469274 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2f527ee8-cbef-4b48-b2f1-1e08c38581d5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:51.613718 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2f527ee8-cbef-4b48-b2f1-1e08c38581d5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:51.622857 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-2f527ee8-cbef-4b48-b2f1-1e08c38581d5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 200 len: 1367 microversion: 2.1 time: 0.168195 Aug 31 09:52:51.623597 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 232/473] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:51 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:52.645262 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-2260bf04-4773-40b6-bdd7-4b29ab57f669 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:52.646050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-2260bf04-4773-40b6-bdd7-4b29ab57f669 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:52.652263 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2260bf04-4773-40b6-bdd7-4b29ab57f669 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:52.652978 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2260bf04-4773-40b6-bdd7-4b29ab57f669 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:52.653161 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2260bf04-4773-40b6-bdd7-4b29ab57f669 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:52.653867 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2260bf04-4773-40b6-bdd7-4b29ab57f669 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:52.654311 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2260bf04-4773-40b6-bdd7-4b29ab57f669 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:52.654724 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2260bf04-4773-40b6-bdd7-4b29ab57f669 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:52.798392 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-2260bf04-4773-40b6-bdd7-4b29ab57f669 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:52.806604 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-2260bf04-4773-40b6-bdd7-4b29ab57f669 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 200 len: 1367 microversion: 2.1 time: 0.166043 Aug 31 09:52:52.807173 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 242/474] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:52 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:53.827914 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-344e4bc2-3444-476a-a198-d204a8b2c6b3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:53.828784 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-344e4bc2-3444-476a-a198-d204a8b2c6b3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:53.831157 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=56 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:53.836618 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-344e4bc2-3444-476a-a198-d204a8b2c6b3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:53.837187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-344e4bc2-3444-476a-a198-d204a8b2c6b3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:53.837647 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-344e4bc2-3444-476a-a198-d204a8b2c6b3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:53.838347 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-344e4bc2-3444-476a-a198-d204a8b2c6b3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:53.838790 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-344e4bc2-3444-476a-a198-d204a8b2c6b3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:53.839205 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-344e4bc2-3444-476a-a198-d204a8b2c6b3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:53.845773 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:53.985440 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-344e4bc2-3444-476a-a198-d204a8b2c6b3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:53.993631 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-344e4bc2-3444-476a-a198-d204a8b2c6b3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 200 len: 1367 microversion: 2.1 time: 0.170028 Aug 31 09:52:53.994240 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 233/475] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:53 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:55.014657 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-8d500ace-9c7c-44ea-ba23-67a1f7b49e64 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:55.015421 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-8d500ace-9c7c-44ea-ba23-67a1f7b49e64 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:55.021830 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8d500ace-9c7c-44ea-ba23-67a1f7b49e64 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:55.022302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8d500ace-9c7c-44ea-ba23-67a1f7b49e64 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:55.022746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8d500ace-9c7c-44ea-ba23-67a1f7b49e64 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:55.023413 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8d500ace-9c7c-44ea-ba23-67a1f7b49e64 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:55.023879 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8d500ace-9c7c-44ea-ba23-67a1f7b49e64 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:55.024293 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8d500ace-9c7c-44ea-ba23-67a1f7b49e64 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:55.160194 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-8d500ace-9c7c-44ea-ba23-67a1f7b49e64 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:55.168256 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-8d500ace-9c7c-44ea-ba23-67a1f7b49e64 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 200 len: 1367 microversion: 2.1 time: 0.157416 Aug 31 09:52:55.168844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 243/476] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:55 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:56.189628 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9be0ff9d-dde0-4056-9e5e-c089e055085b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:56.190233 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-9be0ff9d-dde0-4056-9e5e-c089e055085b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:56.197619 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9be0ff9d-dde0-4056-9e5e-c089e055085b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:56.198144 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9be0ff9d-dde0-4056-9e5e-c089e055085b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:56.198578 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9be0ff9d-dde0-4056-9e5e-c089e055085b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:56.199524 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9be0ff9d-dde0-4056-9e5e-c089e055085b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:56.199899 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9be0ff9d-dde0-4056-9e5e-c089e055085b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:56.200445 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9be0ff9d-dde0-4056-9e5e-c089e055085b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:56.341703 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-9be0ff9d-dde0-4056-9e5e-c089e055085b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:56.351293 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-9be0ff9d-dde0-4056-9e5e-c089e055085b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 200 len: 1367 microversion: 2.1 time: 0.165459 Aug 31 09:52:56.351900 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 234/477] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:56 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:57.381366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-513bb3d6-c612-489c-a7dd-1884cfddbf07 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:57.381998 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-513bb3d6-c612-489c-a7dd-1884cfddbf07 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:57.388543 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-513bb3d6-c612-489c-a7dd-1884cfddbf07 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:57.389025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-513bb3d6-c612-489c-a7dd-1884cfddbf07 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:57.389491 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-513bb3d6-c612-489c-a7dd-1884cfddbf07 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:57.390182 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-513bb3d6-c612-489c-a7dd-1884cfddbf07 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:57.390637 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-513bb3d6-c612-489c-a7dd-1884cfddbf07 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:57.391059 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-513bb3d6-c612-489c-a7dd-1884cfddbf07 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:57.533200 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-513bb3d6-c612-489c-a7dd-1884cfddbf07 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:57.542354 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-513bb3d6-c612-489c-a7dd-1884cfddbf07 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 200 len: 1367 microversion: 2.1 time: 0.164622 Aug 31 09:52:57.542853 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 244/478] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:57 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:58.375298 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-9ab86e87-5bb0-4635-9714-105713e43890 req-9e6d915a-ea81-4297-bb8b-420e68dd99c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f64ad4a-cdde-4c1e-ac02-3977cdadef31", "name": "network-vif-plugged", "status": "completed", "tag": "f6f8c737-1493-4a89-b98d-7b911611cfc5"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:58.381880 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=2 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:58.387876 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-9ab86e87-5bb0-4635-9714-105713e43890 req-9e6d915a-ea81-4297-bb8b-420e68dd99c3 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:58.389336 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-9ab86e87-5bb0-4635-9714-105713e43890 req-9e6d915a-ea81-4297-bb8b-420e68dd99c3 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:58.389785 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-9ab86e87-5bb0-4635-9714-105713e43890 req-9e6d915a-ea81-4297-bb8b-420e68dd99c3 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:58.402036 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-9ab86e87-5bb0-4635-9714-105713e43890 req-9e6d915a-ea81-4297-bb8b-420e68dd99c3 service nova] Creating event network-vif-plugged:f6f8c737-1493-4a89-b98d-7b911611cfc5 for instance 2f64ad4a-cdde-4c1e-ac02-3977cdadef31 on hv-cinder-84496 Aug 31 09:52:58.407803 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-9ab86e87-5bb0-4635-9714-105713e43890 req-9e6d915a-ea81-4297-bb8b-420e68dd99c3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037086 Aug 31 09:52:58.408053 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 235/479] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:58.564652 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-dad641ed-009e-4807-9160-323f651ba5a5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:58.565280 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-dad641ed-009e-4807-9160-323f651ba5a5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:58.567307 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=2 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:58.567976 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=10 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:58.574481 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-dad641ed-009e-4807-9160-323f651ba5a5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:58.575022 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-dad641ed-009e-4807-9160-323f651ba5a5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:58.575407 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-dad641ed-009e-4807-9160-323f651ba5a5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:58.576116 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-dad641ed-009e-4807-9160-323f651ba5a5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:58.576570 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-dad641ed-009e-4807-9160-323f651ba5a5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:58.576995 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-dad641ed-009e-4807-9160-323f651ba5a5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:58.725313 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-dad641ed-009e-4807-9160-323f651ba5a5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:58.733200 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-dad641ed-009e-4807-9160-323f651ba5a5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 200 len: 1367 microversion: 2.1 time: 0.172962 Aug 31 09:52:58.733801 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 245/480] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:58 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:59.756169 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-215fa0ee-d951-48d6-a5e9-debf815dbaea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:59.756879 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-215fa0ee-d951-48d6-a5e9-debf815dbaea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:59.764229 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-215fa0ee-d951-48d6-a5e9-debf815dbaea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:59.764713 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-215fa0ee-d951-48d6-a5e9-debf815dbaea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:59.765148 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-215fa0ee-d951-48d6-a5e9-debf815dbaea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:59.765885 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-215fa0ee-d951-48d6-a5e9-debf815dbaea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:59.766955 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-215fa0ee-d951-48d6-a5e9-debf815dbaea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:59.767419 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-215fa0ee-d951-48d6-a5e9-debf815dbaea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:59.918602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-215fa0ee-d951-48d6-a5e9-debf815dbaea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:59.928552 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-215fa0ee-d951-48d6-a5e9-debf815dbaea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 200 len: 1367 microversion: 2.1 time: 0.176513 Aug 31 09:52:59.929313 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 236/481] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:59 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:00.951118 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a4c25b53-2bd1-4308-89e6-d3c98bcb4bc6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:00.951720 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-a4c25b53-2bd1-4308-89e6-d3c98bcb4bc6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:00.954891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:00.960693 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a4c25b53-2bd1-4308-89e6-d3c98bcb4bc6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:00.961178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a4c25b53-2bd1-4308-89e6-d3c98bcb4bc6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:00.961637 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a4c25b53-2bd1-4308-89e6-d3c98bcb4bc6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:00.962334 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a4c25b53-2bd1-4308-89e6-d3c98bcb4bc6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:00.962789 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a4c25b53-2bd1-4308-89e6-d3c98bcb4bc6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:00.963205 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a4c25b53-2bd1-4308-89e6-d3c98bcb4bc6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:01.112648 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-a4c25b53-2bd1-4308-89e6-d3c98bcb4bc6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:01.121711 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a4c25b53-2bd1-4308-89e6-d3c98bcb4bc6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 200 len: 1367 microversion: 2.1 time: 0.174382 Aug 31 09:53:01.122319 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 246/482] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:00 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:02.143983 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-84bad141-8f7a-410c-8321-76dee25d9285 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:02.144641 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-84bad141-8f7a-410c-8321-76dee25d9285 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:02.151257 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-84bad141-8f7a-410c-8321-76dee25d9285 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:02.151738 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-84bad141-8f7a-410c-8321-76dee25d9285 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:02.152170 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-84bad141-8f7a-410c-8321-76dee25d9285 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:02.152862 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-84bad141-8f7a-410c-8321-76dee25d9285 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:02.153476 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-84bad141-8f7a-410c-8321-76dee25d9285 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:02.153783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-84bad141-8f7a-410c-8321-76dee25d9285 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:02.295867 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-84bad141-8f7a-410c-8321-76dee25d9285 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:02.305792 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-84bad141-8f7a-410c-8321-76dee25d9285 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 200 len: 1367 microversion: 2.1 time: 0.166403 Aug 31 09:53:02.306386 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 237/483] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:02 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:03.328038 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-800d0456-3107-479b-bdcd-506df32bbe48 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:03.328870 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-800d0456-3107-479b-bdcd-506df32bbe48 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:03.335362 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-800d0456-3107-479b-bdcd-506df32bbe48 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:03.335837 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-800d0456-3107-479b-bdcd-506df32bbe48 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:03.336288 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-800d0456-3107-479b-bdcd-506df32bbe48 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:03.337094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-800d0456-3107-479b-bdcd-506df32bbe48 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:03.337449 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-800d0456-3107-479b-bdcd-506df32bbe48 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:03.337863 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-800d0456-3107-479b-bdcd-506df32bbe48 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:03.474272 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-800d0456-3107-479b-bdcd-506df32bbe48 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:03.482050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-800d0456-3107-479b-bdcd-506df32bbe48 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 200 len: 1367 microversion: 2.1 time: 0.158205 Aug 31 09:53:03.482815 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 247/484] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:03 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:04.506857 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-ac8aa887-7cf9-4c44-9b2a-a52c8b790193 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:04.507501 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-ac8aa887-7cf9-4c44-9b2a-a52c8b790193 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:04.514475 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ac8aa887-7cf9-4c44-9b2a-a52c8b790193 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:04.514475 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ac8aa887-7cf9-4c44-9b2a-a52c8b790193 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:04.514897 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ac8aa887-7cf9-4c44-9b2a-a52c8b790193 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:04.515589 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ac8aa887-7cf9-4c44-9b2a-a52c8b790193 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:04.516553 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ac8aa887-7cf9-4c44-9b2a-a52c8b790193 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:04.517312 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ac8aa887-7cf9-4c44-9b2a-a52c8b790193 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:04.660803 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-ac8aa887-7cf9-4c44-9b2a-a52c8b790193 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:04.668911 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-ac8aa887-7cf9-4c44-9b2a-a52c8b790193 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 200 len: 1367 microversion: 2.1 time: 0.165792 Aug 31 09:53:04.669534 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 238/485] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:04 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:05.692049 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-27f237e3-55d4-487d-81ee-82fcab70fab4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:05.692646 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-27f237e3-55d4-487d-81ee-82fcab70fab4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:05.699325 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-27f237e3-55d4-487d-81ee-82fcab70fab4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:05.699835 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-27f237e3-55d4-487d-81ee-82fcab70fab4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:05.700264 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-27f237e3-55d4-487d-81ee-82fcab70fab4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:05.700980 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-27f237e3-55d4-487d-81ee-82fcab70fab4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:05.701472 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-27f237e3-55d4-487d-81ee-82fcab70fab4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:05.701884 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-27f237e3-55d4-487d-81ee-82fcab70fab4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:05.836246 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-27f237e3-55d4-487d-81ee-82fcab70fab4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:05.844048 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-27f237e3-55d4-487d-81ee-82fcab70fab4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 200 len: 1367 microversion: 2.1 time: 0.156438 Aug 31 09:53:05.845594 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 248/486] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:05 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:06.866598 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-bf474b43-240b-4cbc-a6ee-fb122d158b28 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:06.867105 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-bf474b43-240b-4cbc-a6ee-fb122d158b28 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:06.873800 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-bf474b43-240b-4cbc-a6ee-fb122d158b28 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:06.874278 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-bf474b43-240b-4cbc-a6ee-fb122d158b28 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:06.874701 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-bf474b43-240b-4cbc-a6ee-fb122d158b28 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:06.875629 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-bf474b43-240b-4cbc-a6ee-fb122d158b28 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:06.876256 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-bf474b43-240b-4cbc-a6ee-fb122d158b28 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:06.876674 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-bf474b43-240b-4cbc-a6ee-fb122d158b28 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:07.010078 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-bf474b43-240b-4cbc-a6ee-fb122d158b28 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:07.018049 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-bf474b43-240b-4cbc-a6ee-fb122d158b28 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 200 len: 1367 microversion: 2.1 time: 0.155331 Aug 31 09:53:07.018621 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 239/487] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:06 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:08.038907 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-c299d3e9-1b1b-47c2-b627-cf82d3ba6867 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:08.039507 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-c299d3e9-1b1b-47c2-b627-cf82d3ba6867 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:08.046178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c299d3e9-1b1b-47c2-b627-cf82d3ba6867 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:08.046587 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c299d3e9-1b1b-47c2-b627-cf82d3ba6867 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:08.047017 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c299d3e9-1b1b-47c2-b627-cf82d3ba6867 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:08.048411 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c299d3e9-1b1b-47c2-b627-cf82d3ba6867 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:08.048875 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c299d3e9-1b1b-47c2-b627-cf82d3ba6867 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:08.049329 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c299d3e9-1b1b-47c2-b627-cf82d3ba6867 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:08.180992 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-c299d3e9-1b1b-47c2-b627-cf82d3ba6867 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:08.189788 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-c299d3e9-1b1b-47c2-b627-cf82d3ba6867 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 200 len: 1367 microversion: 2.1 time: 0.154571 Aug 31 09:53:08.190359 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 249/488] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:08 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:09.210370 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-319732ee-d410-4ec0-97c2-53e41bdfef2e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:09.210975 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-319732ee-d410-4ec0-97c2-53e41bdfef2e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:09.217515 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-319732ee-d410-4ec0-97c2-53e41bdfef2e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:09.218003 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-319732ee-d410-4ec0-97c2-53e41bdfef2e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:09.218497 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-319732ee-d410-4ec0-97c2-53e41bdfef2e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:09.220178 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-319732ee-d410-4ec0-97c2-53e41bdfef2e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:09.220649 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-319732ee-d410-4ec0-97c2-53e41bdfef2e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:09.221104 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-319732ee-d410-4ec0-97c2-53e41bdfef2e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:09.356776 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-319732ee-d410-4ec0-97c2-53e41bdfef2e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:09.365061 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-319732ee-d410-4ec0-97c2-53e41bdfef2e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 200 len: 1367 microversion: 2.1 time: 0.158698 Aug 31 09:53:09.365658 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 240/489] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:09 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:10.388855 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-e64bbd0e-79a6-4232-b0ed-0317504ab483 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:10.389609 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-e64bbd0e-79a6-4232-b0ed-0317504ab483 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:10.397329 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e64bbd0e-79a6-4232-b0ed-0317504ab483 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:10.398291 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e64bbd0e-79a6-4232-b0ed-0317504ab483 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:10.398291 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e64bbd0e-79a6-4232-b0ed-0317504ab483 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:10.398975 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e64bbd0e-79a6-4232-b0ed-0317504ab483 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:10.399444 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e64bbd0e-79a6-4232-b0ed-0317504ab483 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:10.399924 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e64bbd0e-79a6-4232-b0ed-0317504ab483 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:10.541774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-e64bbd0e-79a6-4232-b0ed-0317504ab483 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:10.550025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-e64bbd0e-79a6-4232-b0ed-0317504ab483 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 200 len: 1367 microversion: 2.1 time: 0.165621 Aug 31 09:53:10.550822 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 250/490] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:10 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:11.572896 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-aede3053-2007-43cd-8a0b-664acdb343c5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:11.573591 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-aede3053-2007-43cd-8a0b-664acdb343c5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:11.581487 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-aede3053-2007-43cd-8a0b-664acdb343c5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:11.581976 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-aede3053-2007-43cd-8a0b-664acdb343c5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:11.582417 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-aede3053-2007-43cd-8a0b-664acdb343c5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:11.583114 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-aede3053-2007-43cd-8a0b-664acdb343c5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:11.583569 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-aede3053-2007-43cd-8a0b-664acdb343c5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:11.583994 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-aede3053-2007-43cd-8a0b-664acdb343c5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:11.715700 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-aede3053-2007-43cd-8a0b-664acdb343c5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:11.723653 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-aede3053-2007-43cd-8a0b-664acdb343c5 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 200 len: 1556 microversion: 2.1 time: 0.154652 Aug 31 09:53:11.724233 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 241/491] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:11 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:11.746607 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b2aaaac6-1096-40da-b448-920852144d14 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:11.747471 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b2aaaac6-1096-40da-b448-920852144d14 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:11.758717 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b2aaaac6-1096-40da-b448-920852144d14 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:11.759196 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b2aaaac6-1096-40da-b448-920852144d14 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:11.759624 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b2aaaac6-1096-40da-b448-920852144d14 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:11.760309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b2aaaac6-1096-40da-b448-920852144d14 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:11.760749 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b2aaaac6-1096-40da-b448-920852144d14 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:11.761160 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b2aaaac6-1096-40da-b448-920852144d14 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:11.764927 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=73 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:11.840623 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b2aaaac6-1096-40da-b448-920852144d14 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099634 Aug 31 09:53:11.841587 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 251/492] 10.222.0.13 () {58 vars in 1275 bytes} [Wed Aug 31 09:53:11 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:13.055427 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-45d7eb95-741b-42d9-9e11-37dbfe324cce req-73ec2ecc-57c0-4950-af96-0e6134327c90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f64ad4a-cdde-4c1e-ac02-3977cdadef31", "tag": "f6f8c737-1493-4a89-b98d-7b911611cfc5"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:13.065836 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-45d7eb95-741b-42d9-9e11-37dbfe324cce req-73ec2ecc-57c0-4950-af96-0e6134327c90 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:13.066388 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-45d7eb95-741b-42d9-9e11-37dbfe324cce req-73ec2ecc-57c0-4950-af96-0e6134327c90 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:13.066877 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-45d7eb95-741b-42d9-9e11-37dbfe324cce req-73ec2ecc-57c0-4950-af96-0e6134327c90 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:13.078590 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-45d7eb95-741b-42d9-9e11-37dbfe324cce req-73ec2ecc-57c0-4950-af96-0e6134327c90 service nova] Creating event network-changed:f6f8c737-1493-4a89-b98d-7b911611cfc5 for instance 2f64ad4a-cdde-4c1e-ac02-3977cdadef31 on hv-cinder-84496 Aug 31 09:53:13.084184 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-45d7eb95-741b-42d9-9e11-37dbfe324cce req-73ec2ecc-57c0-4950-af96-0e6134327c90 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032438 Aug 31 09:53:13.084992 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 242/493] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:21.635912 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-cf8522e5-bd4d-4de2-84eb-571edfcc0fbb tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:21.636442 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-cf8522e5-bd4d-4de2-84eb-571edfcc0fbb tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: 16c07355-b5dd-4e8e-a8bb-e431caacdb59] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:21.642369 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cf8522e5-bd4d-4de2-84eb-571edfcc0fbb tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:21.642844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cf8522e5-bd4d-4de2-84eb-571edfcc0fbb tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:21.643274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cf8522e5-bd4d-4de2-84eb-571edfcc0fbb tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:21.643953 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cf8522e5-bd4d-4de2-84eb-571edfcc0fbb tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:21.644398 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cf8522e5-bd4d-4de2-84eb-571edfcc0fbb tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:21.644841 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cf8522e5-bd4d-4de2-84eb-571edfcc0fbb tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:21.775527 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.objects.instance [None req-cf8522e5-bd4d-4de2-84eb-571edfcc0fbb tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lazy-loading 'services' on Instance uuid 16c07355-b5dd-4e8e-a8bb-e431caacdb59 {{(pid=127170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:53:21.893659 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-cf8522e5-bd4d-4de2-84eb-571edfcc0fbb tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "DELETE /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59/os-volume_attachments/cbb010b3-4d48-4bf9-b6c4-3e9315d4457e" status: 202 len: 0 microversion: 2.1 time: 0.262139 Aug 31 09:53:21.895101 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 252/494] 10.222.0.13 () {58 vars in 1416 bytes} [Wed Aug 31 09:53:21 2022] DELETE /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59/os-volume_attachments/cbb010b3-4d48-4bf9-b6c4-3e9315d4457e => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:53:24.084556 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=19 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:24.085315 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=50 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:24.089348 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-4ed179b1-360e-432e-a5cf-a97c03174465 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:24.089949 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-4ed179b1-360e-432e-a5cf-a97c03174465 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: 16c07355-b5dd-4e8e-a8bb-e431caacdb59] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:24.096908 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4ed179b1-360e-432e-a5cf-a97c03174465 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:24.098053 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4ed179b1-360e-432e-a5cf-a97c03174465 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:24.098486 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4ed179b1-360e-432e-a5cf-a97c03174465 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:24.099394 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4ed179b1-360e-432e-a5cf-a97c03174465 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:24.100622 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4ed179b1-360e-432e-a5cf-a97c03174465 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:24.101237 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4ed179b1-360e-432e-a5cf-a97c03174465 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:24.127668 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-4ed179b1-360e-432e-a5cf-a97c03174465 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: 16c07355-b5dd-4e8e-a8bb-e431caacdb59] Going to try to terminate instance {{(pid=127171) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:53:24.205325 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-4ed179b1-360e-432e-a5cf-a97c03174465 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "DELETE /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59" status: 204 len: 0 microversion: 2.1 time: 0.122187 Aug 31 09:53:24.206235 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 243/495] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 09:53:24 2022] DELETE /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:53:24.216831 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-5395c90b-8954-4178-aa6b-db7add6cbf7a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:24.217580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-5395c90b-8954-4178-aa6b-db7add6cbf7a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: 16c07355-b5dd-4e8e-a8bb-e431caacdb59] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:24.225105 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5395c90b-8954-4178-aa6b-db7add6cbf7a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:24.225629 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5395c90b-8954-4178-aa6b-db7add6cbf7a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:24.226454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5395c90b-8954-4178-aa6b-db7add6cbf7a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:24.227080 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5395c90b-8954-4178-aa6b-db7add6cbf7a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:24.228437 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5395c90b-8954-4178-aa6b-db7add6cbf7a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:24.228989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5395c90b-8954-4178-aa6b-db7add6cbf7a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:24.363654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-5395c90b-8954-4178-aa6b-db7add6cbf7a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:24.371615 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-5395c90b-8954-4178-aa6b-db7add6cbf7a tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59" status: 200 len: 1514 microversion: 2.1 time: 0.159993 Aug 31 09:53:24.372187 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 253/496] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:24 2022] GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:53:25.393644 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-d0656341-a283-4032-917a-de05a006c1bf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:25.394886 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-d0656341-a283-4032-917a-de05a006c1bf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: 16c07355-b5dd-4e8e-a8bb-e431caacdb59] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:25.401763 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d0656341-a283-4032-917a-de05a006c1bf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:25.402239 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d0656341-a283-4032-917a-de05a006c1bf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:25.402670 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d0656341-a283-4032-917a-de05a006c1bf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:25.403365 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d0656341-a283-4032-917a-de05a006c1bf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:25.403805 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d0656341-a283-4032-917a-de05a006c1bf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:25.404216 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d0656341-a283-4032-917a-de05a006c1bf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:25.542560 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-d0656341-a283-4032-917a-de05a006c1bf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:25.551421 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-d0656341-a283-4032-917a-de05a006c1bf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59" status: 200 len: 1514 microversion: 2.1 time: 0.162125 Aug 31 09:53:25.552005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 244/497] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:25 2022] GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:26.572194 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b7bfb5cd-18ee-400b-8d73-6a82d4d5d18d tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:26.572805 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b7bfb5cd-18ee-400b-8d73-6a82d4d5d18d tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: 16c07355-b5dd-4e8e-a8bb-e431caacdb59] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:26.579490 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b7bfb5cd-18ee-400b-8d73-6a82d4d5d18d tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:26.579975 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b7bfb5cd-18ee-400b-8d73-6a82d4d5d18d tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:26.580418 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b7bfb5cd-18ee-400b-8d73-6a82d4d5d18d tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:26.581125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b7bfb5cd-18ee-400b-8d73-6a82d4d5d18d tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:26.581630 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b7bfb5cd-18ee-400b-8d73-6a82d4d5d18d tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:26.582052 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b7bfb5cd-18ee-400b-8d73-6a82d4d5d18d tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:26.725245 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b7bfb5cd-18ee-400b-8d73-6a82d4d5d18d tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:26.733156 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b7bfb5cd-18ee-400b-8d73-6a82d4d5d18d tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59" status: 200 len: 1514 microversion: 2.1 time: 0.164759 Aug 31 09:53:26.733693 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 254/498] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:26 2022] GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:27.753739 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-bd46c2fc-932f-4ea6-92eb-c2abd33c581c tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:27.754354 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-bd46c2fc-932f-4ea6-92eb-c2abd33c581c tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: 16c07355-b5dd-4e8e-a8bb-e431caacdb59] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:27.761030 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bd46c2fc-932f-4ea6-92eb-c2abd33c581c tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:27.761854 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bd46c2fc-932f-4ea6-92eb-c2abd33c581c tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:27.762305 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bd46c2fc-932f-4ea6-92eb-c2abd33c581c tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:27.763128 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bd46c2fc-932f-4ea6-92eb-c2abd33c581c tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:27.763813 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bd46c2fc-932f-4ea6-92eb-c2abd33c581c tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:27.764496 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bd46c2fc-932f-4ea6-92eb-c2abd33c581c tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:27.803884 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-0bbda49c-176e-4d97-9590-0e8c483d997b req-075843df-f9e2-497c-b92f-77e9b8420494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16c07355-b5dd-4e8e-a8bb-e431caacdb59", "name": "network-vif-deleted", "tag": "ce4ee85e-37ea-4686-8ab1-e9a7cbf3d530"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:27.824967 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-0bbda49c-176e-4d97-9590-0e8c483d997b req-075843df-f9e2-497c-b92f-77e9b8420494 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:27.825806 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-0bbda49c-176e-4d97-9590-0e8c483d997b req-075843df-f9e2-497c-b92f-77e9b8420494 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:27.826683 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-0bbda49c-176e-4d97-9590-0e8c483d997b req-075843df-f9e2-497c-b92f-77e9b8420494 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:27.842652 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-bd46c2fc-932f-4ea6-92eb-c2abd33c581c tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:27.851328 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-0bbda49c-176e-4d97-9590-0e8c483d997b req-075843df-f9e2-497c-b92f-77e9b8420494 service nova] Creating event network-vif-deleted:ce4ee85e-37ea-4686-8ab1-e9a7cbf3d530 for instance 16c07355-b5dd-4e8e-a8bb-e431caacdb59 on hv-cinder-84496 Aug 31 09:53:27.851751 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-bd46c2fc-932f-4ea6-92eb-c2abd33c581c tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59" status: 200 len: 1304 microversion: 2.1 time: 0.102430 Aug 31 09:53:27.852334 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 255/499] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:27 2022] GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:53:27.859580 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-0bbda49c-176e-4d97-9590-0e8c483d997b req-075843df-f9e2-497c-b92f-77e9b8420494 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131752 Aug 31 09:53:27.860107 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 245/500] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:28.873450 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b84d8165-bb3d-4887-9b72-4bd41d17ced4 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:28.873986 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b84d8165-bb3d-4887-9b72-4bd41d17ced4 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: 16c07355-b5dd-4e8e-a8bb-e431caacdb59] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:28.880904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b84d8165-bb3d-4887-9b72-4bd41d17ced4 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:28.881400 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b84d8165-bb3d-4887-9b72-4bd41d17ced4 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:28.881842 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b84d8165-bb3d-4887-9b72-4bd41d17ced4 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:28.882534 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b84d8165-bb3d-4887-9b72-4bd41d17ced4 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:28.882981 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b84d8165-bb3d-4887-9b72-4bd41d17ced4 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:28.883399 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b84d8165-bb3d-4887-9b72-4bd41d17ced4 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:28.898476 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-b84d8165-bb3d-4887-9b72-4bd41d17ced4 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] HTTP exception thrown: Instance 16c07355-b5dd-4e8e-a8bb-e431caacdb59 could not be found. Aug 31 09:53:28.900113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b84d8165-bb3d-4887-9b72-4bd41d17ced4 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Request method failure captured: Aug 31 09:53:28.900113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59 HTTP/1.1 Aug 31 09:53:28.900113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 09:53:28.900113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 09:53:28.900113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 09:53:28.900113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 09:53:28.900113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 09:53:28.900113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 09:53:28.900113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 09:53:28.900113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 09:53:28.900113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy8-E5n9VPC8j3EctfzCzZhJmFGTzEpA931HbjHet2Sz4xkl52tf6c5XbUenhQbMXqK7MidEI_CNkm0I5HMSfM4_wVTv7ww_YMPqKROCA_1YBI_bfAZ-zCzs1Bozc4-64NrreH9Lx55mzbupYcYijwDcXZ0hA6rBHpkh940MUo7TATA Aug 31 09:53:28.900113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 09:53:28.900113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 09:53:28.900113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 09:53:28.900113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 09:53:28.900113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 09:53:28.900113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 09:53:28.900113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: f8336bd8ac0c4600a25261e1af19a7df Aug 31 09:53:28.900113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-VolumesSnapshotTestJSON-105813715 Aug 31 09:53:28.900113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 09:53:28.900113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 09:53:28.901691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f8336bd8ac0c4600a25261e1af19a7df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f8336bd8ac0c4600a25261e1af19a7df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f8336bd8ac0c4600a25261e1af19a7df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f8336bd8ac0c4600a25261e1af19a7df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:53:28.901691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-VolumesSnapshotTestJSON-105813715 Aug 31 09:53:28.901691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: f8336bd8ac0c4600a25261e1af19a7df Aug 31 09:53:28.901691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-105813715 Aug 31 09:53:28.901691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-VolumesSnapshotTestJSON-105813715-project Aug 31 09:53:28.901691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 09:53:28.901691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 09:53:28.901691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: f62009b582dd480198ceca6f41e255c2 Aug 31 09:53:28.901691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-VolumesSnapshotTestJSON-105813715-project Aug 31 09:53:28.901691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 09:53:28.901691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Instance 16c07355-b5dd-4e8e-a8bb-e431caacdb59 could not be found. Aug 31 09:53:28.901691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': '16c07355-b5dd-4e8e-a8bb-e431caacdb59'} Aug 31 09:53:28.902510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:53:28.902510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:28.902510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:53:28.902510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:53:28.902510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:53:28.902510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:53:28.902510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:53:28.902510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:53:28.902510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:53:28.902510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:53:28.902510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16c07355-b5dd-4e8e-a8bb-e431caacdb59 could not be found. Aug 31 09:53:28.902510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:53:28.902510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:28.902510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:53:28.902510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:28.902510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:28.902510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:28.902510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:53:28.902510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:53:28.902510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:53:28.904094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:53:28.904094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:53:28.904094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:53:28.904094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:53:28.904094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:53:28.904094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:53:28.904094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:53:28.904094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16c07355-b5dd-4e8e-a8bb-e431caacdb59 could not be found. Aug 31 09:53:28.904094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:53:28.904094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:28.904094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:53:28.904094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:28.904094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:28.904094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:28.904094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:53:28.904094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:53:28.904094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16c07355-b5dd-4e8e-a8bb-e431caacdb59 could not be found. Aug 31 09:53:28.904094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:53:28.905574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b84d8165-bb3d-4887-9b72-4bd41d17ced4 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Returning 404 to user: Instance 16c07355-b5dd-4e8e-a8bb-e431caacdb59 could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:53:28.905574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b84d8165-bb3d-4887-9b72-4bd41d17ced4 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59" status: 404 len: 111 microversion: 2.1 time: 0.032377 Aug 31 09:53:28.905574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 256/501] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:28 2022] GET /compute/v2.1/servers/16c07355-b5dd-4e8e-a8bb-e431caacdb59 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:53:35.771549 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c5c10b13-6b9b-42d6-af13-6c41579ad925 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc9cec97-fb22-4a67-a3a1-340879728ffd"}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:35.774069 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c5c10b13-6b9b-42d6-af13-6c41579ad925 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:35.781139 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c5c10b13-6b9b-42d6-af13-6c41579ad925 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:35.781662 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c5c10b13-6b9b-42d6-af13-6c41579ad925 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:35.782106 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c5c10b13-6b9b-42d6-af13-6c41579ad925 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:35.783023 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c5c10b13-6b9b-42d6-af13-6c41579ad925 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:35.783298 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c5c10b13-6b9b-42d6-af13-6c41579ad925 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:35.783722 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c5c10b13-6b9b-42d6-af13-6c41579ad925 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:36.099340 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c5c10b13-6b9b-42d6-af13-6c41579ad925 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "POST /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.450154 Aug 31 09:53:36.099991 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 246/502] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 31 09:53:35 2022] POST /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e/os-volume_attachments => generated 194 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:53:40.876532 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-2ae6a14c-ecb3-4984-afd3-01b283019a8b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1488786749", "imageRef": "8e078bb9-f274-4984-8128-d31407d49604", "flavorRef": "452", "networks": [{"uuid": "3721ce91-1e27-4c65-a4af-3dca7c9d9b7d"}]}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:40.886274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=21 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:40.886934 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=32,nova_cell1:INSERT=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:40.936385 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.network.neutron [None req-2ae6a14c-ecb3-4984-afd3-01b283019a8b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] validate_networks() for [('3721ce91-1e27-4c65-a4af-3dca7c9d9b7d', None, None, None, None, None)] {{(pid=127170) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:53:41.368596 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-2ae6a14c-ecb3-4984-afd3-01b283019a8b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Flavor limits 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:53:41.369017 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-2ae6a14c-ecb3-4984-afd3-01b283019a8b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Image limits 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:53:41.369794 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-2ae6a14c-ecb3-4984-afd3-01b283019a8b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Flavor pref 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:53:41.370205 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-2ae6a14c-ecb3-4984-afd3-01b283019a8b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Image pref 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:53:41.370612 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-2ae6a14c-ecb3-4984-afd3-01b283019a8b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:53:41.380792 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2ae6a14c-ecb3-4984-afd3-01b283019a8b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:41.381271 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2ae6a14c-ecb3-4984-afd3-01b283019a8b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:41.381743 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2ae6a14c-ecb3-4984-afd3-01b283019a8b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:41.382471 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2ae6a14c-ecb3-4984-afd3-01b283019a8b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:41.382924 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2ae6a14c-ecb3-4984-afd3-01b283019a8b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:41.383342 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2ae6a14c-ecb3-4984-afd3-01b283019a8b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:41.403345 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-2ae6a14c-ecb3-4984-afd3-01b283019a8b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Getting quotas for project f8336bd8ac0c4600a25261e1af19a7df. Resources: {'ram', 'instances', 'cores'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:53:41.410133 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-2ae6a14c-ecb3-4984-afd3-01b283019a8b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Getting quotas for user f62009b582dd480198ceca6f41e255c2 and project f8336bd8ac0c4600a25261e1af19a7df. Resources: {'ram', 'instances', 'cores'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:53:41.423935 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-2ae6a14c-ecb3-4984-afd3-01b283019a8b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Going to run 1 instances... {{(pid=127170) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:53:41.426902 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-2ae6a14c-ecb3-4984-afd3-01b283019a8b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8e078bb9-f274-4984-8128-d31407d49604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:53:41.479727 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-2ae6a14c-ecb3-4984-afd3-01b283019a8b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607102 Aug 31 09:53:41.480373 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 257/503] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 31 09:53:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:53:41.492196 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c3e3c052-4c1a-44a4-bc5f-494c5c77549b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:41.492885 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c3e3c052-4c1a-44a4-bc5f-494c5c77549b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:41.560645 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c3e3c052-4c1a-44a4-bc5f-494c5c77549b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:41.574027 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c3e3c052-4c1a-44a4-bc5f-494c5c77549b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085" status: 200 len: 1219 microversion: 2.1 time: 0.086560 Aug 31 09:53:41.574625 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 247/504] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:41 2022] GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:42.597675 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-bf19a70a-3f05-4df2-8643-96dafd631c57 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:42.598295 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-bf19a70a-3f05-4df2-8643-96dafd631c57 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:42.608007 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bf19a70a-3f05-4df2-8643-96dafd631c57 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:42.608504 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bf19a70a-3f05-4df2-8643-96dafd631c57 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:42.608927 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bf19a70a-3f05-4df2-8643-96dafd631c57 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:42.609657 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bf19a70a-3f05-4df2-8643-96dafd631c57 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:42.610101 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bf19a70a-3f05-4df2-8643-96dafd631c57 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:42.610518 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bf19a70a-3f05-4df2-8643-96dafd631c57 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:42.683467 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-bf19a70a-3f05-4df2-8643-96dafd631c57 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:42.692612 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-bf19a70a-3f05-4df2-8643-96dafd631c57 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085" status: 200 len: 1271 microversion: 2.1 time: 0.100703 Aug 31 09:53:42.693562 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 258/505] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:42 2022] GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085 => generated 1271 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:43.713666 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-7476b104-f376-4c8a-808a-1d23081d6daa tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:43.714550 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-7476b104-f376-4c8a-808a-1d23081d6daa tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:43.723134 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7476b104-f376-4c8a-808a-1d23081d6daa tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:43.723939 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7476b104-f376-4c8a-808a-1d23081d6daa tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:43.724079 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7476b104-f376-4c8a-808a-1d23081d6daa tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:43.724801 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7476b104-f376-4c8a-808a-1d23081d6daa tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:43.725258 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7476b104-f376-4c8a-808a-1d23081d6daa tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:43.726279 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7476b104-f376-4c8a-808a-1d23081d6daa tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:43.901624 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7476b104-f376-4c8a-808a-1d23081d6daa tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:43.911325 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-7476b104-f376-4c8a-808a-1d23081d6daa tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085" status: 200 len: 1319 microversion: 2.1 time: 0.201655 Aug 31 09:53:43.912331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 248/506] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:43 2022] GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:44.454905 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-d25d1111-5e06-4296-90c2-50339f610c0d req-b961b0e8-1594-4643-8e8a-577795437d56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eef9aa55-0ea3-48de-b97b-b20c8bef0085", "tag": "7a6232d6-44ce-4f87-bd9d-73e5a1b1d1ad"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:44.471599 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-d25d1111-5e06-4296-90c2-50339f610c0d req-b961b0e8-1594-4643-8e8a-577795437d56 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:44.473182 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-d25d1111-5e06-4296-90c2-50339f610c0d req-b961b0e8-1594-4643-8e8a-577795437d56 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:44.473630 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-d25d1111-5e06-4296-90c2-50339f610c0d req-b961b0e8-1594-4643-8e8a-577795437d56 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:44.486401 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-d25d1111-5e06-4296-90c2-50339f610c0d req-b961b0e8-1594-4643-8e8a-577795437d56 service nova] Creating event network-changed:7a6232d6-44ce-4f87-bd9d-73e5a1b1d1ad for instance eef9aa55-0ea3-48de-b97b-b20c8bef0085 on hv-cinder-84496 Aug 31 09:53:44.493142 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-d25d1111-5e06-4296-90c2-50339f610c0d req-b961b0e8-1594-4643-8e8a-577795437d56 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044660 Aug 31 09:53:44.493767 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 259/507] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:44.932562 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-a0f16d11-8081-4a8d-b738-22b43a5dfccd tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:44.933421 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-a0f16d11-8081-4a8d-b738-22b43a5dfccd tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:44.940999 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a0f16d11-8081-4a8d-b738-22b43a5dfccd tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:44.941524 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a0f16d11-8081-4a8d-b738-22b43a5dfccd tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:44.941955 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a0f16d11-8081-4a8d-b738-22b43a5dfccd tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:44.942864 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a0f16d11-8081-4a8d-b738-22b43a5dfccd tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:44.943318 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a0f16d11-8081-4a8d-b738-22b43a5dfccd tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:44.943824 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a0f16d11-8081-4a8d-b738-22b43a5dfccd tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:45.084365 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-a0f16d11-8081-4a8d-b738-22b43a5dfccd tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:45.093887 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-a0f16d11-8081-4a8d-b738-22b43a5dfccd tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085" status: 200 len: 1319 microversion: 2.1 time: 0.165309 Aug 31 09:53:45.094475 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 249/508] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:44 2022] GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:46.116185 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f8e7c53e-f1fc-4062-be1f-c2405016bc55 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:46.116878 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-f8e7c53e-f1fc-4062-be1f-c2405016bc55 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:46.123664 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f8e7c53e-f1fc-4062-be1f-c2405016bc55 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:46.124145 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f8e7c53e-f1fc-4062-be1f-c2405016bc55 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:46.124577 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f8e7c53e-f1fc-4062-be1f-c2405016bc55 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:46.125407 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f8e7c53e-f1fc-4062-be1f-c2405016bc55 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:46.125865 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f8e7c53e-f1fc-4062-be1f-c2405016bc55 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:46.126288 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f8e7c53e-f1fc-4062-be1f-c2405016bc55 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:46.267752 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-f8e7c53e-f1fc-4062-be1f-c2405016bc55 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:46.277077 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-f8e7c53e-f1fc-4062-be1f-c2405016bc55 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085" status: 200 len: 1319 microversion: 2.1 time: 0.166313 Aug 31 09:53:46.277686 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 260/509] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:46 2022] GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:47.301629 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-30f45bab-fabd-4100-b650-5a8aa3cff674 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:47.302671 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-30f45bab-fabd-4100-b650-5a8aa3cff674 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:47.310167 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-30f45bab-fabd-4100-b650-5a8aa3cff674 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:47.310650 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-30f45bab-fabd-4100-b650-5a8aa3cff674 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:47.311088 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-30f45bab-fabd-4100-b650-5a8aa3cff674 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:47.311786 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-30f45bab-fabd-4100-b650-5a8aa3cff674 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:47.312234 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-30f45bab-fabd-4100-b650-5a8aa3cff674 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:47.312656 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-30f45bab-fabd-4100-b650-5a8aa3cff674 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:47.454542 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-30f45bab-fabd-4100-b650-5a8aa3cff674 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:47.463300 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-30f45bab-fabd-4100-b650-5a8aa3cff674 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085" status: 200 len: 1319 microversion: 2.1 time: 0.167838 Aug 31 09:53:47.463903 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 250/510] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:47 2022] GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:48.483763 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-8f6b8588-6112-48e1-81c3-d86fcf3fead6 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:48.484407 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-8f6b8588-6112-48e1-81c3-d86fcf3fead6 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:48.492957 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8f6b8588-6112-48e1-81c3-d86fcf3fead6 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:48.493658 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8f6b8588-6112-48e1-81c3-d86fcf3fead6 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:48.494198 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8f6b8588-6112-48e1-81c3-d86fcf3fead6 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:48.495496 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8f6b8588-6112-48e1-81c3-d86fcf3fead6 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:48.496146 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8f6b8588-6112-48e1-81c3-d86fcf3fead6 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:48.496613 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8f6b8588-6112-48e1-81c3-d86fcf3fead6 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:48.652549 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-8f6b8588-6112-48e1-81c3-d86fcf3fead6 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:48.661761 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-8f6b8588-6112-48e1-81c3-d86fcf3fead6 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085" status: 200 len: 1319 microversion: 2.1 time: 0.181865 Aug 31 09:53:48.662366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 261/511] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:48 2022] GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:49.682826 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-5d293570-1b92-4d35-b06a-a9b183f4f0bf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:49.683527 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-5d293570-1b92-4d35-b06a-a9b183f4f0bf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:49.691022 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5d293570-1b92-4d35-b06a-a9b183f4f0bf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:49.691512 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5d293570-1b92-4d35-b06a-a9b183f4f0bf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:49.691934 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5d293570-1b92-4d35-b06a-a9b183f4f0bf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:49.692631 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5d293570-1b92-4d35-b06a-a9b183f4f0bf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:49.693073 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5d293570-1b92-4d35-b06a-a9b183f4f0bf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:49.693525 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5d293570-1b92-4d35-b06a-a9b183f4f0bf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:49.867425 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-5d293570-1b92-4d35-b06a-a9b183f4f0bf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:49.875914 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-5d293570-1b92-4d35-b06a-a9b183f4f0bf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085" status: 200 len: 1319 microversion: 2.1 time: 0.196920 Aug 31 09:53:49.877047 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 251/512] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:49 2022] GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:50.899149 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-ce381dfd-759b-483f-8f2c-c5033590c211 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:50.899723 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-ce381dfd-759b-483f-8f2c-c5033590c211 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:50.906960 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ce381dfd-759b-483f-8f2c-c5033590c211 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:50.907494 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ce381dfd-759b-483f-8f2c-c5033590c211 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:50.907994 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ce381dfd-759b-483f-8f2c-c5033590c211 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:50.909319 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ce381dfd-759b-483f-8f2c-c5033590c211 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:50.909963 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ce381dfd-759b-483f-8f2c-c5033590c211 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:50.910400 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ce381dfd-759b-483f-8f2c-c5033590c211 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:51.048203 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-ce381dfd-759b-483f-8f2c-c5033590c211 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:51.060642 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-ce381dfd-759b-483f-8f2c-c5033590c211 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085" status: 200 len: 1319 microversion: 2.1 time: 0.166161 Aug 31 09:53:51.061221 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 262/513] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:50 2022] GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:51.135675 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-5197776f-80e4-42c6-b66b-638d0b1218e1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:51.137980 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-5197776f-80e4-42c6-b66b-638d0b1218e1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:51.144866 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5197776f-80e4-42c6-b66b-638d0b1218e1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:51.145336 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5197776f-80e4-42c6-b66b-638d0b1218e1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:51.145794 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5197776f-80e4-42c6-b66b-638d0b1218e1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:51.146471 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5197776f-80e4-42c6-b66b-638d0b1218e1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:51.146917 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5197776f-80e4-42c6-b66b-638d0b1218e1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:51.147719 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5197776f-80e4-42c6-b66b-638d0b1218e1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:51.171174 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.objects.instance [None req-5197776f-80e4-42c6-b66b-638d0b1218e1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lazy-loading 'flavor' on Instance uuid ad92550c-f29b-4f97-9511-a2f1ffa98e3e {{(pid=127171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:53:51.297375 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-5197776f-80e4-42c6-b66b-638d0b1218e1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "POST /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e/action" status: 200 len: 32 microversion: 2.1 time: 0.165890 Aug 31 09:53:51.298062 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 252/514] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 31 09:53:51 2022] POST /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 09:53:51.307626 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-1802f9de-935f-4d28-948a-be55294eaf40 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:51.308229 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-1802f9de-935f-4d28-948a-be55294eaf40 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:51.315872 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1802f9de-935f-4d28-948a-be55294eaf40 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:51.316368 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1802f9de-935f-4d28-948a-be55294eaf40 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:51.316803 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1802f9de-935f-4d28-948a-be55294eaf40 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:51.318318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1802f9de-935f-4d28-948a-be55294eaf40 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:51.319213 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1802f9de-935f-4d28-948a-be55294eaf40 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:51.319642 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1802f9de-935f-4d28-948a-be55294eaf40 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:51.389940 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=2 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:51.418184 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=6 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:51.465028 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-1802f9de-935f-4d28-948a-be55294eaf40 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:51.473791 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-1802f9de-935f-4d28-948a-be55294eaf40 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1734 microversion: 2.1 time: 0.170111 Aug 31 09:53:51.474374 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 263/515] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:51 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:52.078718 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=2 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:52.083147 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-49130323-3e9d-4dba-9b2a-06dade007202 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:52.083867 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-49130323-3e9d-4dba-9b2a-06dade007202 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:52.090426 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-49130323-3e9d-4dba-9b2a-06dade007202 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:52.090904 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-49130323-3e9d-4dba-9b2a-06dade007202 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:52.091330 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-49130323-3e9d-4dba-9b2a-06dade007202 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:52.092015 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-49130323-3e9d-4dba-9b2a-06dade007202 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:52.092459 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-49130323-3e9d-4dba-9b2a-06dade007202 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:52.092870 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-49130323-3e9d-4dba-9b2a-06dade007202 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:52.229976 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-49130323-3e9d-4dba-9b2a-06dade007202 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:52.238573 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-49130323-3e9d-4dba-9b2a-06dade007202 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085" status: 200 len: 1319 microversion: 2.1 time: 0.160557 Aug 31 09:53:52.239139 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 253/516] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:52 2022] GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:52.474905 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-e59feab7-e49f-497d-8538-3ddb1495e3c8 req-ed37ff2c-1cee-4a62-a393-3718305b98ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eef9aa55-0ea3-48de-b97b-b20c8bef0085", "name": "network-vif-plugged", "status": "completed", "tag": "7a6232d6-44ce-4f87-bd9d-73e5a1b1d1ad"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:52.485156 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-e59feab7-e49f-497d-8538-3ddb1495e3c8 req-ed37ff2c-1cee-4a62-a393-3718305b98ba service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:52.485676 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-e59feab7-e49f-497d-8538-3ddb1495e3c8 req-ed37ff2c-1cee-4a62-a393-3718305b98ba service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:52.486133 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-e59feab7-e49f-497d-8538-3ddb1495e3c8 req-ed37ff2c-1cee-4a62-a393-3718305b98ba service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:52.495034 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-99c6cfd3-b8d4-4e71-a487-bacea11d470e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:52.495736 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-99c6cfd3-b8d4-4e71-a487-bacea11d470e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:52.502292 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-99c6cfd3-b8d4-4e71-a487-bacea11d470e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:52.503259 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-99c6cfd3-b8d4-4e71-a487-bacea11d470e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:52.503829 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-99c6cfd3-b8d4-4e71-a487-bacea11d470e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:52.504547 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-99c6cfd3-b8d4-4e71-a487-bacea11d470e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:52.505003 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-99c6cfd3-b8d4-4e71-a487-bacea11d470e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:52.505452 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-99c6cfd3-b8d4-4e71-a487-bacea11d470e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:52.508050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-e59feab7-e49f-497d-8538-3ddb1495e3c8 req-ed37ff2c-1cee-4a62-a393-3718305b98ba service nova] Creating event network-vif-plugged:7a6232d6-44ce-4f87-bd9d-73e5a1b1d1ad for instance eef9aa55-0ea3-48de-b97b-b20c8bef0085 on hv-cinder-84496 Aug 31 09:53:52.513180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-e59feab7-e49f-497d-8538-3ddb1495e3c8 req-ed37ff2c-1cee-4a62-a393-3718305b98ba service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104368 Aug 31 09:53:52.513826 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 264/517] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:52.657182 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-99c6cfd3-b8d4-4e71-a487-bacea11d470e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:52.666186 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-99c6cfd3-b8d4-4e71-a487-bacea11d470e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1734 microversion: 2.1 time: 0.175591 Aug 31 09:53:52.666774 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 254/518] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:52 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:53:53.259888 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-11de9d84-7d97-49f9-8ee5-1e3b26bf354b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:53.260581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-11de9d84-7d97-49f9-8ee5-1e3b26bf354b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:53.266957 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-11de9d84-7d97-49f9-8ee5-1e3b26bf354b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:53.267439 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-11de9d84-7d97-49f9-8ee5-1e3b26bf354b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:53.268784 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-11de9d84-7d97-49f9-8ee5-1e3b26bf354b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:53.269520 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-11de9d84-7d97-49f9-8ee5-1e3b26bf354b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:53.269972 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-11de9d84-7d97-49f9-8ee5-1e3b26bf354b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:53.270390 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-11de9d84-7d97-49f9-8ee5-1e3b26bf354b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:53.406872 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-11de9d84-7d97-49f9-8ee5-1e3b26bf354b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:53.415168 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-11de9d84-7d97-49f9-8ee5-1e3b26bf354b tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085" status: 200 len: 1319 microversion: 2.1 time: 0.159624 Aug 31 09:53:53.415743 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 265/519] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:53 2022] GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:53.687795 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-272bcaad-a042-4080-a51d-42e22588544a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:53.688397 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-272bcaad-a042-4080-a51d-42e22588544a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:53.694792 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-272bcaad-a042-4080-a51d-42e22588544a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:53.695266 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-272bcaad-a042-4080-a51d-42e22588544a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:53.695693 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-272bcaad-a042-4080-a51d-42e22588544a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:53.696373 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-272bcaad-a042-4080-a51d-42e22588544a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:53.696812 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-272bcaad-a042-4080-a51d-42e22588544a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:53.697222 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-272bcaad-a042-4080-a51d-42e22588544a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:53.839303 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-272bcaad-a042-4080-a51d-42e22588544a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:53.848096 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-272bcaad-a042-4080-a51d-42e22588544a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1734 microversion: 2.1 time: 0.164066 Aug 31 09:53:53.848683 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 255/520] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:53 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:54.435378 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-e09fbd30-f0ff-487f-97f9-5b98cbfaf582 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:54.435971 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-e09fbd30-f0ff-487f-97f9-5b98cbfaf582 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:54.442699 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e09fbd30-f0ff-487f-97f9-5b98cbfaf582 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:54.443180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e09fbd30-f0ff-487f-97f9-5b98cbfaf582 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:54.443700 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e09fbd30-f0ff-487f-97f9-5b98cbfaf582 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:54.444573 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e09fbd30-f0ff-487f-97f9-5b98cbfaf582 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:54.445121 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e09fbd30-f0ff-487f-97f9-5b98cbfaf582 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:54.445738 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e09fbd30-f0ff-487f-97f9-5b98cbfaf582 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:54.579318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-e09fbd30-f0ff-487f-97f9-5b98cbfaf582 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:54.587178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-e09fbd30-f0ff-487f-97f9-5b98cbfaf582 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085" status: 200 len: 1319 microversion: 2.1 time: 0.155671 Aug 31 09:53:54.587754 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 266/521] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:54 2022] GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:53:54.868899 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-38eaea6c-e93a-4ad3-8ba8-b752f7995a10 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:54.869760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-38eaea6c-e93a-4ad3-8ba8-b752f7995a10 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:54.872001 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:54.877566 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38eaea6c-e93a-4ad3-8ba8-b752f7995a10 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:54.878077 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38eaea6c-e93a-4ad3-8ba8-b752f7995a10 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:54.878524 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38eaea6c-e93a-4ad3-8ba8-b752f7995a10 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:54.879213 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38eaea6c-e93a-4ad3-8ba8-b752f7995a10 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:54.879666 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38eaea6c-e93a-4ad3-8ba8-b752f7995a10 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:54.880124 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38eaea6c-e93a-4ad3-8ba8-b752f7995a10 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:54.885063 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:55.016312 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-38eaea6c-e93a-4ad3-8ba8-b752f7995a10 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:55.025267 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-38eaea6c-e93a-4ad3-8ba8-b752f7995a10 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1734 microversion: 2.1 time: 0.160261 Aug 31 09:53:55.025870 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 256/522] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:54 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:55.608266 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-27c19d70-953c-42ec-bc6c-e6b4201b45a8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:55.608859 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-27c19d70-953c-42ec-bc6c-e6b4201b45a8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:55.616026 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-27c19d70-953c-42ec-bc6c-e6b4201b45a8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:55.616510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-27c19d70-953c-42ec-bc6c-e6b4201b45a8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:55.616936 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-27c19d70-953c-42ec-bc6c-e6b4201b45a8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:55.617658 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-27c19d70-953c-42ec-bc6c-e6b4201b45a8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:55.618104 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-27c19d70-953c-42ec-bc6c-e6b4201b45a8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:55.618712 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-27c19d70-953c-42ec-bc6c-e6b4201b45a8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:55.777619 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-27c19d70-953c-42ec-bc6c-e6b4201b45a8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:55.786395 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-27c19d70-953c-42ec-bc6c-e6b4201b45a8 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085" status: 200 len: 1319 microversion: 2.1 time: 0.182329 Aug 31 09:53:55.786983 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 267/523] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:55 2022] GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:56.047628 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-cd940925-c9e6-412c-b90d-4b3bb4130e35 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:56.048345 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-cd940925-c9e6-412c-b90d-4b3bb4130e35 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:56.056062 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cd940925-c9e6-412c-b90d-4b3bb4130e35 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:56.056565 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cd940925-c9e6-412c-b90d-4b3bb4130e35 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:56.057008 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cd940925-c9e6-412c-b90d-4b3bb4130e35 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:56.057784 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cd940925-c9e6-412c-b90d-4b3bb4130e35 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:56.058244 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cd940925-c9e6-412c-b90d-4b3bb4130e35 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:56.058676 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cd940925-c9e6-412c-b90d-4b3bb4130e35 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:56.198558 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-cd940925-c9e6-412c-b90d-4b3bb4130e35 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:56.206992 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-cd940925-c9e6-412c-b90d-4b3bb4130e35 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1734 microversion: 2.1 time: 0.163330 Aug 31 09:53:56.207574 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 257/524] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:56 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:56.806799 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-2bed350c-2a4a-455f-92bb-bc671c73c11e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:56.807379 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-2bed350c-2a4a-455f-92bb-bc671c73c11e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:56.813844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2bed350c-2a4a-455f-92bb-bc671c73c11e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:56.814324 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2bed350c-2a4a-455f-92bb-bc671c73c11e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:56.815294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2bed350c-2a4a-455f-92bb-bc671c73c11e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:56.816172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2bed350c-2a4a-455f-92bb-bc671c73c11e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:56.816625 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2bed350c-2a4a-455f-92bb-bc671c73c11e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:56.817042 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2bed350c-2a4a-455f-92bb-bc671c73c11e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:56.948172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-2bed350c-2a4a-455f-92bb-bc671c73c11e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:56.956633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-2bed350c-2a4a-455f-92bb-bc671c73c11e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085" status: 200 len: 1508 microversion: 2.1 time: 0.153800 Aug 31 09:53:56.957204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 268/525] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:56 2022] GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:56.976431 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-a6d7bae0-bf82-4b69-8d14-1b829050ffca tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8818c19-5708-4ba3-806e-899ca0da4c34", "device": "/dev/sdb"}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:56.978924 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-a6d7bae0-bf82-4b69-8d14-1b829050ffca tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:56.984967 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a6d7bae0-bf82-4b69-8d14-1b829050ffca tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:56.985479 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a6d7bae0-bf82-4b69-8d14-1b829050ffca tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:56.985915 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a6d7bae0-bf82-4b69-8d14-1b829050ffca tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:56.987317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a6d7bae0-bf82-4b69-8d14-1b829050ffca tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:56.987789 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a6d7bae0-bf82-4b69-8d14-1b829050ffca tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:56.988283 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a6d7bae0-bf82-4b69-8d14-1b829050ffca tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:57.228219 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-2fb86165-6169-4cbf-9e2a-090bce9a6432 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:57.228830 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-2fb86165-6169-4cbf-9e2a-090bce9a6432 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:57.235737 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2fb86165-6169-4cbf-9e2a-090bce9a6432 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:57.236301 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2fb86165-6169-4cbf-9e2a-090bce9a6432 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:57.237526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2fb86165-6169-4cbf-9e2a-090bce9a6432 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:57.239098 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2fb86165-6169-4cbf-9e2a-090bce9a6432 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:57.239621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2fb86165-6169-4cbf-9e2a-090bce9a6432 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:57.240173 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2fb86165-6169-4cbf-9e2a-090bce9a6432 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:57.385793 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-2fb86165-6169-4cbf-9e2a-090bce9a6432 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:57.394826 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-2fb86165-6169-4cbf-9e2a-090bce9a6432 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1734 microversion: 2.1 time: 0.170502 Aug 31 09:53:57.395745 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 269/526] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:57 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:57.427364 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-a6d7bae0-bf82-4b69-8d14-1b829050ffca tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "POST /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.454742 Aug 31 09:53:57.427966 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 258/527] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 31 09:53:56 2022] POST /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085/os-volume_attachments => generated 194 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:58.418772 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a62e469d-2dd4-4ff1-93a0-2f79a83d6438 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:58.419407 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-a62e469d-2dd4-4ff1-93a0-2f79a83d6438 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:58.426180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a62e469d-2dd4-4ff1-93a0-2f79a83d6438 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:58.426657 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a62e469d-2dd4-4ff1-93a0-2f79a83d6438 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:58.427082 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a62e469d-2dd4-4ff1-93a0-2f79a83d6438 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:58.427764 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a62e469d-2dd4-4ff1-93a0-2f79a83d6438 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:58.428203 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a62e469d-2dd4-4ff1-93a0-2f79a83d6438 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:58.428613 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a62e469d-2dd4-4ff1-93a0-2f79a83d6438 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:58.575541 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-a62e469d-2dd4-4ff1-93a0-2f79a83d6438 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:58.584190 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a62e469d-2dd4-4ff1-93a0-2f79a83d6438 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1734 microversion: 2.1 time: 0.169800 Aug 31 09:53:58.585204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 270/528] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:58 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:59.606823 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-5698993a-0008-4cd1-8e81-2bd43d874f94 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:59.608407 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-5698993a-0008-4cd1-8e81-2bd43d874f94 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:59.620030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5698993a-0008-4cd1-8e81-2bd43d874f94 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:59.620986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5698993a-0008-4cd1-8e81-2bd43d874f94 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:59.621905 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5698993a-0008-4cd1-8e81-2bd43d874f94 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:59.622836 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5698993a-0008-4cd1-8e81-2bd43d874f94 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:59.623291 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5698993a-0008-4cd1-8e81-2bd43d874f94 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:59.623718 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5698993a-0008-4cd1-8e81-2bd43d874f94 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:59.771394 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-5698993a-0008-4cd1-8e81-2bd43d874f94 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:59.780530 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-5698993a-0008-4cd1-8e81-2bd43d874f94 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1734 microversion: 2.1 time: 0.177884 Aug 31 09:53:59.781123 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 259/529] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:59 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:00.802226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-cafb5654-5aa8-4154-b60a-1899cfb03558 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:00.802867 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-cafb5654-5aa8-4154-b60a-1899cfb03558 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:00.809252 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cafb5654-5aa8-4154-b60a-1899cfb03558 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:00.809759 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cafb5654-5aa8-4154-b60a-1899cfb03558 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:00.810190 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cafb5654-5aa8-4154-b60a-1899cfb03558 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:00.810870 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cafb5654-5aa8-4154-b60a-1899cfb03558 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:00.811313 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cafb5654-5aa8-4154-b60a-1899cfb03558 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:00.811728 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cafb5654-5aa8-4154-b60a-1899cfb03558 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:00.944527 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-cafb5654-5aa8-4154-b60a-1899cfb03558 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:00.952956 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-cafb5654-5aa8-4154-b60a-1899cfb03558 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1734 microversion: 2.1 time: 0.154605 Aug 31 09:54:00.953565 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 271/530] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:00 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:01.975454 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-827f579c-153a-49f5-9475-4e5948e6ab79 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:01.976057 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-827f579c-153a-49f5-9475-4e5948e6ab79 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:01.984187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-827f579c-153a-49f5-9475-4e5948e6ab79 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:01.985223 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-827f579c-153a-49f5-9475-4e5948e6ab79 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:01.985679 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-827f579c-153a-49f5-9475-4e5948e6ab79 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:01.986630 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-827f579c-153a-49f5-9475-4e5948e6ab79 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:01.987078 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-827f579c-153a-49f5-9475-4e5948e6ab79 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:01.987496 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-827f579c-153a-49f5-9475-4e5948e6ab79 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:02.123467 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-827f579c-153a-49f5-9475-4e5948e6ab79 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:02.131800 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-827f579c-153a-49f5-9475-4e5948e6ab79 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1734 microversion: 2.1 time: 0.160230 Aug 31 09:54:02.132369 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 260/531] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:01 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:03.152240 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-cf2e3883-7c80-4a61-93b1-700f16ffa032 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:03.152779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-cf2e3883-7c80-4a61-93b1-700f16ffa032 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:03.158979 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cf2e3883-7c80-4a61-93b1-700f16ffa032 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:03.159826 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cf2e3883-7c80-4a61-93b1-700f16ffa032 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:03.160269 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cf2e3883-7c80-4a61-93b1-700f16ffa032 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:03.160961 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cf2e3883-7c80-4a61-93b1-700f16ffa032 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:03.161449 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cf2e3883-7c80-4a61-93b1-700f16ffa032 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:03.161846 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cf2e3883-7c80-4a61-93b1-700f16ffa032 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:03.302326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-cf2e3883-7c80-4a61-93b1-700f16ffa032 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:03.310956 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-cf2e3883-7c80-4a61-93b1-700f16ffa032 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1734 microversion: 2.1 time: 0.162852 Aug 31 09:54:03.311540 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 272/532] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:03 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:04.333480 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-48f60424-f96f-4136-9bc9-525ee404a45a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:04.334073 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-48f60424-f96f-4136-9bc9-525ee404a45a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:04.341046 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-48f60424-f96f-4136-9bc9-525ee404a45a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:04.341046 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-48f60424-f96f-4136-9bc9-525ee404a45a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:04.341426 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-48f60424-f96f-4136-9bc9-525ee404a45a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:04.342178 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-48f60424-f96f-4136-9bc9-525ee404a45a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:04.342619 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-48f60424-f96f-4136-9bc9-525ee404a45a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:04.343032 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-48f60424-f96f-4136-9bc9-525ee404a45a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:04.485080 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-48f60424-f96f-4136-9bc9-525ee404a45a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:04.494998 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-48f60424-f96f-4136-9bc9-525ee404a45a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1734 microversion: 2.1 time: 0.165525 Aug 31 09:54:04.495579 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 261/533] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:04 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:05.516823 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-137a87ef-7521-4922-93c3-56940e87713f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:05.517496 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-137a87ef-7521-4922-93c3-56940e87713f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:05.524519 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-137a87ef-7521-4922-93c3-56940e87713f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:05.525008 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-137a87ef-7521-4922-93c3-56940e87713f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:05.525478 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-137a87ef-7521-4922-93c3-56940e87713f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:05.526182 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-137a87ef-7521-4922-93c3-56940e87713f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:05.526634 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-137a87ef-7521-4922-93c3-56940e87713f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:05.527190 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-137a87ef-7521-4922-93c3-56940e87713f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:05.658414 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-137a87ef-7521-4922-93c3-56940e87713f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:05.667598 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-137a87ef-7521-4922-93c3-56940e87713f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1734 microversion: 2.1 time: 0.154604 Aug 31 09:54:05.668169 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 273/534] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:05 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:06.689946 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9a6b3908-f10f-4b45-b570-1c1185e6c2ca tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:06.690760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-9a6b3908-f10f-4b45-b570-1c1185e6c2ca tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:06.696986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9a6b3908-f10f-4b45-b570-1c1185e6c2ca tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:06.697494 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9a6b3908-f10f-4b45-b570-1c1185e6c2ca tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:06.697924 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9a6b3908-f10f-4b45-b570-1c1185e6c2ca tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:06.698609 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9a6b3908-f10f-4b45-b570-1c1185e6c2ca tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:06.699051 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9a6b3908-f10f-4b45-b570-1c1185e6c2ca tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:06.699465 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9a6b3908-f10f-4b45-b570-1c1185e6c2ca tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:06.830122 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-9a6b3908-f10f-4b45-b570-1c1185e6c2ca tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:06.839256 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-9a6b3908-f10f-4b45-b570-1c1185e6c2ca tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1734 microversion: 2.1 time: 0.153427 Aug 31 09:54:06.839949 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 262/535] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:06 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:07.861534 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-0392cd32-0c3c-40b0-8f69-07ade9e42353 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:07.862081 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-0392cd32-0c3c-40b0-8f69-07ade9e42353 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:07.869803 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0392cd32-0c3c-40b0-8f69-07ade9e42353 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:07.870279 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0392cd32-0c3c-40b0-8f69-07ade9e42353 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:07.870703 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0392cd32-0c3c-40b0-8f69-07ade9e42353 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:07.871396 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0392cd32-0c3c-40b0-8f69-07ade9e42353 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:07.871841 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0392cd32-0c3c-40b0-8f69-07ade9e42353 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:07.872260 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0392cd32-0c3c-40b0-8f69-07ade9e42353 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:08.019676 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-0392cd32-0c3c-40b0-8f69-07ade9e42353 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:08.029680 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-0392cd32-0c3c-40b0-8f69-07ade9e42353 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1734 microversion: 2.1 time: 0.171969 Aug 31 09:54:08.030275 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 274/536] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:07 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:09.053248 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-73ed3bd5-4db9-4d42-b0b9-f0c6597d70f5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:09.054174 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-73ed3bd5-4db9-4d42-b0b9-f0c6597d70f5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:09.062546 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-73ed3bd5-4db9-4d42-b0b9-f0c6597d70f5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:09.063303 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-73ed3bd5-4db9-4d42-b0b9-f0c6597d70f5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:09.063851 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-73ed3bd5-4db9-4d42-b0b9-f0c6597d70f5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:09.064655 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-73ed3bd5-4db9-4d42-b0b9-f0c6597d70f5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:09.065339 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-73ed3bd5-4db9-4d42-b0b9-f0c6597d70f5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:09.066582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-73ed3bd5-4db9-4d42-b0b9-f0c6597d70f5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:09.234654 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-73ed3bd5-4db9-4d42-b0b9-f0c6597d70f5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:09.245027 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-73ed3bd5-4db9-4d42-b0b9-f0c6597d70f5 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1734 microversion: 2.1 time: 0.197435 Aug 31 09:54:09.245669 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 263/537] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:09 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1734 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:10.268529 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-5ba0f836-b85c-44d6-a2e8-f35c0f066a3b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:10.269111 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-5ba0f836-b85c-44d6-a2e8-f35c0f066a3b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:10.276053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5ba0f836-b85c-44d6-a2e8-f35c0f066a3b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:10.276542 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5ba0f836-b85c-44d6-a2e8-f35c0f066a3b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:10.276971 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5ba0f836-b85c-44d6-a2e8-f35c0f066a3b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:10.277728 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5ba0f836-b85c-44d6-a2e8-f35c0f066a3b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:10.278180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5ba0f836-b85c-44d6-a2e8-f35c0f066a3b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:10.278596 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5ba0f836-b85c-44d6-a2e8-f35c0f066a3b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:10.299318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=100 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:10.436789 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-5ba0f836-b85c-44d6-a2e8-f35c0f066a3b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:10.446615 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-5ba0f836-b85c-44d6-a2e8-f35c0f066a3b tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1734 microversion: 2.1 time: 0.182176 Aug 31 09:54:10.447213 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 275/538] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:10 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1734 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:11.472172 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9edfca5a-a726-4735-adb2-81e330fafefc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:11.473178 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-9edfca5a-a726-4735-adb2-81e330fafefc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:11.480965 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9edfca5a-a726-4735-adb2-81e330fafefc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:11.481489 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9edfca5a-a726-4735-adb2-81e330fafefc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:11.481933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9edfca5a-a726-4735-adb2-81e330fafefc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:11.482650 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9edfca5a-a726-4735-adb2-81e330fafefc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:11.483100 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9edfca5a-a726-4735-adb2-81e330fafefc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:11.483529 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9edfca5a-a726-4735-adb2-81e330fafefc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:11.630473 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-9edfca5a-a726-4735-adb2-81e330fafefc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:11.639336 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-9edfca5a-a726-4735-adb2-81e330fafefc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1734 microversion: 2.1 time: 0.173600 Aug 31 09:54:11.639941 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 264/539] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:11 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:12.662453 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-d3754c5c-c759-4c7b-bd8b-9e5c57a55fc2 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:12.663040 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-d3754c5c-c759-4c7b-bd8b-9e5c57a55fc2 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:12.665416 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:12.671550 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d3754c5c-c759-4c7b-bd8b-9e5c57a55fc2 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:12.672031 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d3754c5c-c759-4c7b-bd8b-9e5c57a55fc2 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:12.672464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d3754c5c-c759-4c7b-bd8b-9e5c57a55fc2 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:12.673168 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d3754c5c-c759-4c7b-bd8b-9e5c57a55fc2 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:12.673641 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d3754c5c-c759-4c7b-bd8b-9e5c57a55fc2 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:12.674092 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d3754c5c-c759-4c7b-bd8b-9e5c57a55fc2 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:12.811697 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-d3754c5c-c759-4c7b-bd8b-9e5c57a55fc2 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:12.820426 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-d3754c5c-c759-4c7b-bd8b-9e5c57a55fc2 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1734 microversion: 2.1 time: 0.162940 Aug 31 09:54:12.821015 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 276/540] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:12 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:13.843183 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-27a8a1da-2d82-4bb4-93c8-c58533ac69df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:13.843747 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-27a8a1da-2d82-4bb4-93c8-c58533ac69df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:13.851267 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-27a8a1da-2d82-4bb4-93c8-c58533ac69df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:13.851755 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-27a8a1da-2d82-4bb4-93c8-c58533ac69df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:13.852198 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-27a8a1da-2d82-4bb4-93c8-c58533ac69df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:13.852901 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-27a8a1da-2d82-4bb4-93c8-c58533ac69df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:13.853351 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-27a8a1da-2d82-4bb4-93c8-c58533ac69df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:13.853797 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-27a8a1da-2d82-4bb4-93c8-c58533ac69df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:14.006078 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-27a8a1da-2d82-4bb4-93c8-c58533ac69df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:14.014860 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-27a8a1da-2d82-4bb4-93c8-c58533ac69df tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1734 microversion: 2.1 time: 0.175661 Aug 31 09:54:14.015454 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 265/541] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:13 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:15.040321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-3eeee708-0a69-499b-b713-ef33168a0cbe tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:15.041113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-3eeee708-0a69-499b-b713-ef33168a0cbe tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:15.048511 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3eeee708-0a69-499b-b713-ef33168a0cbe tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:15.049024 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3eeee708-0a69-499b-b713-ef33168a0cbe tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:15.049549 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3eeee708-0a69-499b-b713-ef33168a0cbe tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:15.050482 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3eeee708-0a69-499b-b713-ef33168a0cbe tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:15.051243 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3eeee708-0a69-499b-b713-ef33168a0cbe tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:15.051714 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3eeee708-0a69-499b-b713-ef33168a0cbe tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:15.197166 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-3eeee708-0a69-499b-b713-ef33168a0cbe tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:15.206034 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-3eeee708-0a69-499b-b713-ef33168a0cbe tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1734 microversion: 2.1 time: 0.170440 Aug 31 09:54:15.206734 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 277/542] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:15 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:54:16.228498 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-d8e98163-9674-4b8a-80bc-9814b602cd96 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:16.229037 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-d8e98163-9674-4b8a-80bc-9814b602cd96 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:16.235798 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d8e98163-9674-4b8a-80bc-9814b602cd96 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:16.236287 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d8e98163-9674-4b8a-80bc-9814b602cd96 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:16.236722 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d8e98163-9674-4b8a-80bc-9814b602cd96 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:16.237453 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d8e98163-9674-4b8a-80bc-9814b602cd96 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:16.237914 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d8e98163-9674-4b8a-80bc-9814b602cd96 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:16.238330 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d8e98163-9674-4b8a-80bc-9814b602cd96 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:16.393710 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-d8e98163-9674-4b8a-80bc-9814b602cd96 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:16.402879 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-d8e98163-9674-4b8a-80bc-9814b602cd96 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1734 microversion: 2.1 time: 0.178495 Aug 31 09:54:16.403478 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 266/543] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:16 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:17.426116 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-685278d4-3b74-4d2c-aeed-6b563ceff657 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:17.426822 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-685278d4-3b74-4d2c-aeed-6b563ceff657 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:17.433632 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-685278d4-3b74-4d2c-aeed-6b563ceff657 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:17.434159 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-685278d4-3b74-4d2c-aeed-6b563ceff657 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:17.434645 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-685278d4-3b74-4d2c-aeed-6b563ceff657 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:17.435386 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-685278d4-3b74-4d2c-aeed-6b563ceff657 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:17.435874 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-685278d4-3b74-4d2c-aeed-6b563ceff657 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:17.436364 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-685278d4-3b74-4d2c-aeed-6b563ceff657 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:17.583155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-685278d4-3b74-4d2c-aeed-6b563ceff657 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:17.599008 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-685278d4-3b74-4d2c-aeed-6b563ceff657 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1734 microversion: 2.1 time: 0.177279 Aug 31 09:54:17.600070 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 278/544] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:17 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:18.632793 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-667fcade-c505-4542-a44e-f05ca0a08f47 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:18.634007 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-667fcade-c505-4542-a44e-f05ca0a08f47 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:18.645478 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-667fcade-c505-4542-a44e-f05ca0a08f47 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:18.646149 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-667fcade-c505-4542-a44e-f05ca0a08f47 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:18.646921 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-667fcade-c505-4542-a44e-f05ca0a08f47 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:18.648133 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-667fcade-c505-4542-a44e-f05ca0a08f47 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:18.648944 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-667fcade-c505-4542-a44e-f05ca0a08f47 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:18.649725 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-667fcade-c505-4542-a44e-f05ca0a08f47 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:18.824109 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-667fcade-c505-4542-a44e-f05ca0a08f47 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:18.835235 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-667fcade-c505-4542-a44e-f05ca0a08f47 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1734 microversion: 2.1 time: 0.206615 Aug 31 09:54:18.835832 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 267/545] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:18 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1734 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:54:19.856580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-bef75242-5d3e-4ed1-93ee-61c1fcde5346 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:19.857207 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-bef75242-5d3e-4ed1-93ee-61c1fcde5346 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:19.865373 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bef75242-5d3e-4ed1-93ee-61c1fcde5346 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:19.866263 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bef75242-5d3e-4ed1-93ee-61c1fcde5346 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:19.867074 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bef75242-5d3e-4ed1-93ee-61c1fcde5346 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:19.868332 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bef75242-5d3e-4ed1-93ee-61c1fcde5346 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:19.869458 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bef75242-5d3e-4ed1-93ee-61c1fcde5346 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:19.870213 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bef75242-5d3e-4ed1-93ee-61c1fcde5346 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:20.032081 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-bef75242-5d3e-4ed1-93ee-61c1fcde5346 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:20.040496 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-bef75242-5d3e-4ed1-93ee-61c1fcde5346 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1734 microversion: 2.1 time: 0.187800 Aug 31 09:54:20.041060 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 279/546] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:19 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1734 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:21.061815 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-3700dadb-fcd5-41e9-a351-cda6625fce32 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:21.062641 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-3700dadb-fcd5-41e9-a351-cda6625fce32 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:21.072570 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3700dadb-fcd5-41e9-a351-cda6625fce32 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:21.073301 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3700dadb-fcd5-41e9-a351-cda6625fce32 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:21.073997 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3700dadb-fcd5-41e9-a351-cda6625fce32 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:21.076474 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3700dadb-fcd5-41e9-a351-cda6625fce32 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:21.076474 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3700dadb-fcd5-41e9-a351-cda6625fce32 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:21.076474 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3700dadb-fcd5-41e9-a351-cda6625fce32 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:21.294877 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-3700dadb-fcd5-41e9-a351-cda6625fce32 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:21.305336 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-3700dadb-fcd5-41e9-a351-cda6625fce32 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1734 microversion: 2.1 time: 0.247816 Aug 31 09:54:21.306256 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 268/547] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:21 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1734 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:22.189175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-55b00d9c-68b9-414c-9b31-9bf95a6fb116 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:22.189787 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-55b00d9c-68b9-414c-9b31-9bf95a6fb116 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:22.197738 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-55b00d9c-68b9-414c-9b31-9bf95a6fb116 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:22.198227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-55b00d9c-68b9-414c-9b31-9bf95a6fb116 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:22.198819 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-55b00d9c-68b9-414c-9b31-9bf95a6fb116 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:22.199613 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-55b00d9c-68b9-414c-9b31-9bf95a6fb116 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:22.200061 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-55b00d9c-68b9-414c-9b31-9bf95a6fb116 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:22.200525 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-55b00d9c-68b9-414c-9b31-9bf95a6fb116 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:22.290528 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.objects.instance [None req-55b00d9c-68b9-414c-9b31-9bf95a6fb116 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lazy-loading 'services' on Instance uuid eef9aa55-0ea3-48de-b97b-b20c8bef0085 {{(pid=127170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:54:22.327862 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9d3a81b9-9bd1-4f15-b187-49d81c33a995 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:22.328541 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-9d3a81b9-9bd1-4f15-b187-49d81c33a995 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:22.335883 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9d3a81b9-9bd1-4f15-b187-49d81c33a995 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:22.336369 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9d3a81b9-9bd1-4f15-b187-49d81c33a995 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:22.336797 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9d3a81b9-9bd1-4f15-b187-49d81c33a995 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:22.337525 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9d3a81b9-9bd1-4f15-b187-49d81c33a995 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:22.338177 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9d3a81b9-9bd1-4f15-b187-49d81c33a995 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:22.338369 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9d3a81b9-9bd1-4f15-b187-49d81c33a995 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:22.377031 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-55b00d9c-68b9-414c-9b31-9bf95a6fb116 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "DELETE /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085/os-volume_attachments/b8818c19-5708-4ba3-806e-899ca0da4c34" status: 202 len: 0 microversion: 2.1 time: 0.191637 Aug 31 09:54:22.377940 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 280/548] 10.222.0.13 () {58 vars in 1416 bytes} [Wed Aug 31 09:54:22 2022] DELETE /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085/os-volume_attachments/b8818c19-5708-4ba3-806e-899ca0da4c34 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:54:22.538945 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-9d3a81b9-9bd1-4f15-b187-49d81c33a995 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:22.550196 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-9d3a81b9-9bd1-4f15-b187-49d81c33a995 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1714 microversion: 2.1 time: 0.225698 Aug 31 09:54:22.550915 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 269/549] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:22 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1714 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:22.617987 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f709ac48-6f6c-48f3-b945-ecea78b65617 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:22.618821 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-f709ac48-6f6c-48f3-b945-ecea78b65617 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:22.625063 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f709ac48-6f6c-48f3-b945-ecea78b65617 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:22.625600 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f709ac48-6f6c-48f3-b945-ecea78b65617 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:22.626026 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f709ac48-6f6c-48f3-b945-ecea78b65617 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:22.626718 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f709ac48-6f6c-48f3-b945-ecea78b65617 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:22.627161 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f709ac48-6f6c-48f3-b945-ecea78b65617 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:22.627580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f709ac48-6f6c-48f3-b945-ecea78b65617 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:22.711601 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-f709ac48-6f6c-48f3-b945-ecea78b65617 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] HTTP exception thrown: Cannot 'detach_volume' instance ad92550c-f29b-4f97-9511-a2f1ffa98e3e while it is in vm_state rescued Aug 31 09:54:22.713210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f709ac48-6f6c-48f3-b945-ecea78b65617 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Request method failure captured: Aug 31 09:54:22.713210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: DELETE /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e/os-volume_attachments/cc9cec97-fb22-4a67-a3a1-340879728ffd HTTP/1.1 Aug 31 09:54:22.713210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 09:54:22.713210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 09:54:22.713210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 09:54:22.713210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 09:54:22.713210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 09:54:22.713210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 09:54:22.713210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 09:54:22.713210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 09:54:22.713210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy5OTDLNRfLh5I253GwLv23LsAUrNMn0r9xaten2h7_1_5xHwhGyUEaQYYHfDmmHCd0ZNSB8h1zSiuyFLSm9-AvFKxWjgyu8fdEQl6UJfoKqRgJfuqhoDcaQr_FT6z1TSznbTbqj78fmKsXLoDaJbKqpRSnNN2tpZX8CNlgCtAi_Hak Aug 31 09:54:22.713210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 09:54:22.713210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 09:54:22.713210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 09:54:22.713210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 09:54:22.713210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 09:54:22.713210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 09:54:22.713210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: c0fc6660b5494415915cdf2b325e5bd6 Aug 31 09:54:22.713210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-742304945 Aug 31 09:54:22.713210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 09:54:22.713210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 09:54:22.714782 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c0fc6660b5494415915cdf2b325e5bd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c0fc6660b5494415915cdf2b325e5bd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c0fc6660b5494415915cdf2b325e5bd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c0fc6660b5494415915cdf2b325e5bd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:54:22.714782 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-ServerRescueNegativeTestJSON-742304945 Aug 31 09:54:22.714782 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: c0fc6660b5494415915cdf2b325e5bd6 Aug 31 09:54:22.714782 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-742304945 Aug 31 09:54:22.714782 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-ServerRescueNegativeTestJSON-742304945-project Aug 31 09:54:22.714782 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 09:54:22.714782 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 09:54:22.714782 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: 886e40cf192d46c2b2e7eb2a95ec62e1 Aug 31 09:54:22.714782 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-ServerRescueNegativeTestJSON-742304945-project Aug 31 09:54:22.714782 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 09:54:22.714782 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Cannot 'detach_volume' instance ad92550c-f29b-4f97-9511-a2f1ffa98e3e while it is in vm_state rescued Aug 31 09:54:22.715621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'server_id': 'ad92550c-f29b-4f97-9511-a2f1ffa98e3e', 'id': 'cc9cec97-fb22-4a67-a3a1-340879728ffd'} Aug 31 09:54:22.715621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:54:22.715621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:54:22.715621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 09:54:22.715621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 09:54:22.715621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 09:54:22.715621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 09:54:22.715621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 09:54:22.715621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 09:54:22.715621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ad92550c-f29b-4f97-9511-a2f1ffa98e3e in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 31 09:54:22.715621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:54:22.715621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:54:22.715621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:54:22.715621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:54:22.715621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:54:22.715621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:54:22.715621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:54:22.715621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:54:22.715621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:54:22.715621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:54:22.717067 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 31 09:54:22.717067 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 09:54:22.717067 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 09:54:22.717067 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 09:54:22.717067 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ad92550c-f29b-4f97-9511-a2f1ffa98e3e while it is in vm_state rescued Aug 31 09:54:22.717067 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:54:22.717067 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:54:22.717067 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:54:22.717067 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:54:22.717067 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:54:22.717067 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:54:22.717067 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:54:22.717067 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:54:22.717067 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ad92550c-f29b-4f97-9511-a2f1ffa98e3e while it is in vm_state rescued Aug 31 09:54:22.717067 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:54:22.717067 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f709ac48-6f6c-48f3-b945-ecea78b65617 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Returning 409 to user: Cannot 'detach_volume' instance ad92550c-f29b-4f97-9511-a2f1ffa98e3e while it is in vm_state rescued {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:54:22.718251 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-f709ac48-6f6c-48f3-b945-ecea78b65617 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e/os-volume_attachments/cc9cec97-fb22-4a67-a3a1-340879728ffd" status: 409 len: 152 microversion: 2.1 time: 0.101066 Aug 31 09:54:22.718251 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 281/550] 10.222.0.13 () {58 vars in 1416 bytes} [Wed Aug 31 09:54:22 2022] DELETE /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e/os-volume_attachments/cc9cec97-fb22-4a67-a3a1-340879728ffd => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 09:54:22.724111 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-197f1850-eace-4b9d-b18f-10418c249ca4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:22.724610 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-197f1850-eace-4b9d-b18f-10418c249ca4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:22.730794 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-197f1850-eace-4b9d-b18f-10418c249ca4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:22.731267 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-197f1850-eace-4b9d-b18f-10418c249ca4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:22.731691 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-197f1850-eace-4b9d-b18f-10418c249ca4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:22.732369 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-197f1850-eace-4b9d-b18f-10418c249ca4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:22.732812 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-197f1850-eace-4b9d-b18f-10418c249ca4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:22.733652 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-197f1850-eace-4b9d-b18f-10418c249ca4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:22.783486 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:22.808002 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-197f1850-eace-4b9d-b18f-10418c249ca4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "POST /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e/action" status: 202 len: 0 microversion: 2.1 time: 0.087724 Aug 31 09:54:22.808631 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 270/551] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 31 09:54:22 2022] POST /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:54:22.817909 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-79122ceb-7507-405e-877c-7e1dde0efc3a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:22.818525 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-79122ceb-7507-405e-877c-7e1dde0efc3a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:22.825436 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-79122ceb-7507-405e-877c-7e1dde0efc3a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:22.825927 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-79122ceb-7507-405e-877c-7e1dde0efc3a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:22.826362 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-79122ceb-7507-405e-877c-7e1dde0efc3a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:22.827051 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-79122ceb-7507-405e-877c-7e1dde0efc3a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:22.827500 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-79122ceb-7507-405e-877c-7e1dde0efc3a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:22.827915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-79122ceb-7507-405e-877c-7e1dde0efc3a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:22.967805 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-79122ceb-7507-405e-877c-7e1dde0efc3a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:22.979501 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-79122ceb-7507-405e-877c-7e1dde0efc3a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1722 microversion: 2.1 time: 0.166234 Aug 31 09:54:22.980183 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 282/552] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:22 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:24.002960 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-d175a2f6-f27b-4642-b09e-e078d4e4a5d1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:24.004335 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-d175a2f6-f27b-4642-b09e-e078d4e4a5d1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:24.011715 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d175a2f6-f27b-4642-b09e-e078d4e4a5d1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:24.012297 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d175a2f6-f27b-4642-b09e-e078d4e4a5d1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:24.012803 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d175a2f6-f27b-4642-b09e-e078d4e4a5d1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:24.013615 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d175a2f6-f27b-4642-b09e-e078d4e4a5d1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:24.014158 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d175a2f6-f27b-4642-b09e-e078d4e4a5d1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:24.014646 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d175a2f6-f27b-4642-b09e-e078d4e4a5d1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:24.194330 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-d175a2f6-f27b-4642-b09e-e078d4e4a5d1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:24.205401 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-d175a2f6-f27b-4642-b09e-e078d4e4a5d1 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1722 microversion: 2.1 time: 0.206678 Aug 31 09:54:24.207724 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 271/553] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:23 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:54:24.596084 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-37d4b080-69e0-4a17-8cb9-3e09a461bbdf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:24.596892 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-37d4b080-69e0-4a17-8cb9-3e09a461bbdf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:24.604259 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-37d4b080-69e0-4a17-8cb9-3e09a461bbdf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:24.604919 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-37d4b080-69e0-4a17-8cb9-3e09a461bbdf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:24.605370 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-37d4b080-69e0-4a17-8cb9-3e09a461bbdf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:24.606274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-37d4b080-69e0-4a17-8cb9-3e09a461bbdf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:24.606550 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-37d4b080-69e0-4a17-8cb9-3e09a461bbdf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:24.606972 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-37d4b080-69e0-4a17-8cb9-3e09a461bbdf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:24.635187 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-37d4b080-69e0-4a17-8cb9-3e09a461bbdf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] Going to try to terminate instance {{(pid=127170) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:54:24.719738 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-37d4b080-69e0-4a17-8cb9-3e09a461bbdf tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "DELETE /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085" status: 204 len: 0 microversion: 2.1 time: 0.127416 Aug 31 09:54:24.720320 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 283/554] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 09:54:24 2022] DELETE /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:54:24.729176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-12aab74f-604a-42a9-a905-7c88436e2521 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:24.729828 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-12aab74f-604a-42a9-a905-7c88436e2521 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:24.735974 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-12aab74f-604a-42a9-a905-7c88436e2521 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:24.736447 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-12aab74f-604a-42a9-a905-7c88436e2521 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:24.736872 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-12aab74f-604a-42a9-a905-7c88436e2521 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:24.738215 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-12aab74f-604a-42a9-a905-7c88436e2521 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:24.738766 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-12aab74f-604a-42a9-a905-7c88436e2521 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:24.739162 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-12aab74f-604a-42a9-a905-7c88436e2521 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:24.877656 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-12aab74f-604a-42a9-a905-7c88436e2521 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:24.890343 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-12aab74f-604a-42a9-a905-7c88436e2521 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085" status: 200 len: 1514 microversion: 2.1 time: 0.164942 Aug 31 09:54:24.890933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 272/555] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:24 2022] GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:25.235295 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-901eb972-9fb8-428a-95f3-977bf1c09f27 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:25.235978 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-901eb972-9fb8-428a-95f3-977bf1c09f27 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:25.243047 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-901eb972-9fb8-428a-95f3-977bf1c09f27 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:25.243798 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-901eb972-9fb8-428a-95f3-977bf1c09f27 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:25.244224 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-901eb972-9fb8-428a-95f3-977bf1c09f27 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:25.244911 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-901eb972-9fb8-428a-95f3-977bf1c09f27 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:25.245350 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-901eb972-9fb8-428a-95f3-977bf1c09f27 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:25.245789 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-901eb972-9fb8-428a-95f3-977bf1c09f27 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:25.396017 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-901eb972-9fb8-428a-95f3-977bf1c09f27 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:25.405524 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-901eb972-9fb8-428a-95f3-977bf1c09f27 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1722 microversion: 2.1 time: 0.174301 Aug 31 09:54:25.406125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 284/556] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:25 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:25.912749 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-405e05f4-5d0f-456d-a947-abcd19f407a2 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:25.913364 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-405e05f4-5d0f-456d-a947-abcd19f407a2 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:25.915914 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=34 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:25.921450 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-405e05f4-5d0f-456d-a947-abcd19f407a2 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:25.921947 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-405e05f4-5d0f-456d-a947-abcd19f407a2 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:25.922375 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-405e05f4-5d0f-456d-a947-abcd19f407a2 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:25.923077 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-405e05f4-5d0f-456d-a947-abcd19f407a2 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:25.923521 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-405e05f4-5d0f-456d-a947-abcd19f407a2 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:25.923938 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-405e05f4-5d0f-456d-a947-abcd19f407a2 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:26.068425 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-405e05f4-5d0f-456d-a947-abcd19f407a2 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:26.076667 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-405e05f4-5d0f-456d-a947-abcd19f407a2 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085" status: 200 len: 1514 microversion: 2.1 time: 0.169130 Aug 31 09:54:26.077252 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 273/557] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:25 2022] GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:26.430732 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-37a0d0dc-ab59-463b-a86f-5cd7f6f7a2ee tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:26.431471 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-37a0d0dc-ab59-463b-a86f-5cd7f6f7a2ee tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:26.438112 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-37a0d0dc-ab59-463b-a86f-5cd7f6f7a2ee tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:26.438589 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-37a0d0dc-ab59-463b-a86f-5cd7f6f7a2ee tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:26.439117 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-37a0d0dc-ab59-463b-a86f-5cd7f6f7a2ee tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:26.440024 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-37a0d0dc-ab59-463b-a86f-5cd7f6f7a2ee tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:26.440920 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-37a0d0dc-ab59-463b-a86f-5cd7f6f7a2ee tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:26.441547 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-37a0d0dc-ab59-463b-a86f-5cd7f6f7a2ee tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:26.612906 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-37a0d0dc-ab59-463b-a86f-5cd7f6f7a2ee tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:26.629179 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-37a0d0dc-ab59-463b-a86f-5cd7f6f7a2ee tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1722 microversion: 2.1 time: 0.201973 Aug 31 09:54:26.630290 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 285/558] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:26 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:27.098378 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-5e5d3468-e34e-4be8-b22b-4c71b0bdaeca tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:27.099033 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-5e5d3468-e34e-4be8-b22b-4c71b0bdaeca tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:27.105729 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5e5d3468-e34e-4be8-b22b-4c71b0bdaeca tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:27.106213 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5e5d3468-e34e-4be8-b22b-4c71b0bdaeca tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:27.106647 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5e5d3468-e34e-4be8-b22b-4c71b0bdaeca tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:27.107345 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5e5d3468-e34e-4be8-b22b-4c71b0bdaeca tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:27.107788 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5e5d3468-e34e-4be8-b22b-4c71b0bdaeca tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:27.108204 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5e5d3468-e34e-4be8-b22b-4c71b0bdaeca tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:27.251867 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-5e5d3468-e34e-4be8-b22b-4c71b0bdaeca tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:27.260543 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-5e5d3468-e34e-4be8-b22b-4c71b0bdaeca tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085" status: 200 len: 1514 microversion: 2.1 time: 0.166311 Aug 31 09:54:27.261118 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 274/559] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:27 2022] GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:27.650763 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f021d0b2-49f7-44f1-9b14-ba74c2e0011d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:27.651373 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-f021d0b2-49f7-44f1-9b14-ba74c2e0011d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:27.658498 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f021d0b2-49f7-44f1-9b14-ba74c2e0011d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:27.660607 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f021d0b2-49f7-44f1-9b14-ba74c2e0011d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:27.661050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f021d0b2-49f7-44f1-9b14-ba74c2e0011d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:27.661810 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f021d0b2-49f7-44f1-9b14-ba74c2e0011d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:27.662259 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f021d0b2-49f7-44f1-9b14-ba74c2e0011d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:27.662682 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f021d0b2-49f7-44f1-9b14-ba74c2e0011d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:27.805235 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-f021d0b2-49f7-44f1-9b14-ba74c2e0011d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:27.814287 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-f021d0b2-49f7-44f1-9b14-ba74c2e0011d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1722 microversion: 2.1 time: 0.167191 Aug 31 09:54:27.814798 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 286/560] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:27 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:28.286599 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-dbc655f4-c29e-4c31-a30c-20753528c4a0 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:28.287745 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-dbc655f4-c29e-4c31-a30c-20753528c4a0 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:28.298609 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dbc655f4-c29e-4c31-a30c-20753528c4a0 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:28.300093 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dbc655f4-c29e-4c31-a30c-20753528c4a0 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:28.300938 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dbc655f4-c29e-4c31-a30c-20753528c4a0 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:28.302247 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dbc655f4-c29e-4c31-a30c-20753528c4a0 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:28.303094 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dbc655f4-c29e-4c31-a30c-20753528c4a0 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:28.303882 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dbc655f4-c29e-4c31-a30c-20753528c4a0 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:28.459547 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-dbc655f4-c29e-4c31-a30c-20753528c4a0 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:28.467730 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-dbc655f4-c29e-4c31-a30c-20753528c4a0 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085" status: 200 len: 1514 microversion: 2.1 time: 0.188932 Aug 31 09:54:28.468459 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 275/561] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:28 2022] GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085 => generated 1514 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:28.835779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-d5f21968-f2ac-457a-97e3-2dfd0fdca408 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:28.836397 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-d5f21968-f2ac-457a-97e3-2dfd0fdca408 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:28.843116 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d5f21968-f2ac-457a-97e3-2dfd0fdca408 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:28.843605 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d5f21968-f2ac-457a-97e3-2dfd0fdca408 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:28.844037 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d5f21968-f2ac-457a-97e3-2dfd0fdca408 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:28.844742 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d5f21968-f2ac-457a-97e3-2dfd0fdca408 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:28.845197 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d5f21968-f2ac-457a-97e3-2dfd0fdca408 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:28.845646 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d5f21968-f2ac-457a-97e3-2dfd0fdca408 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:28.988216 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-d5f21968-f2ac-457a-97e3-2dfd0fdca408 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:28.998123 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-d5f21968-f2ac-457a-97e3-2dfd0fdca408 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1722 microversion: 2.1 time: 0.166131 Aug 31 09:54:28.998709 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 287/562] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:28 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:54:29.491412 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b9f28302-17e9-4ba0-840d-f17be23f147e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:29.492302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b9f28302-17e9-4ba0-840d-f17be23f147e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:29.499456 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b9f28302-17e9-4ba0-840d-f17be23f147e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:29.500045 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b9f28302-17e9-4ba0-840d-f17be23f147e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:29.500547 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b9f28302-17e9-4ba0-840d-f17be23f147e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:29.501289 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b9f28302-17e9-4ba0-840d-f17be23f147e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:29.501930 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b9f28302-17e9-4ba0-840d-f17be23f147e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:29.503310 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b9f28302-17e9-4ba0-840d-f17be23f147e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:29.547162 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c4e30b7b-40d3-443a-96e1-559405e6f86e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:29.547997 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c4e30b7b-40d3-443a-96e1-559405e6f86e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:29.556991 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4e30b7b-40d3-443a-96e1-559405e6f86e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:29.557506 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4e30b7b-40d3-443a-96e1-559405e6f86e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:29.557971 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4e30b7b-40d3-443a-96e1-559405e6f86e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:29.560186 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4e30b7b-40d3-443a-96e1-559405e6f86e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:29.560859 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4e30b7b-40d3-443a-96e1-559405e6f86e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:29.561535 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4e30b7b-40d3-443a-96e1-559405e6f86e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:29.730251 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b9f28302-17e9-4ba0-840d-f17be23f147e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:29.743540 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b9f28302-17e9-4ba0-840d-f17be23f147e tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085" status: 200 len: 1514 microversion: 2.1 time: 0.256871 Aug 31 09:54:29.744399 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 288/563] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:29 2022] GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085 => generated 1514 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:54:29.760733 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.objects.instance [None req-c4e30b7b-40d3-443a-96e1-559405e6f86e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lazy-loading 'services' on Instance uuid e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 {{(pid=127171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:54:29.899804 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c4e30b7b-40d3-443a-96e1-559405e6f86e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8/os-volume_attachments/f91fc1ad-01df-4111-9f05-1240f48b63e3" status: 202 len: 0 microversion: 2.1 time: 0.514820 Aug 31 09:54:29.900781 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 276/564] 10.222.0.13 () {58 vars in 1416 bytes} [Wed Aug 31 09:54:29 2022] DELETE /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8/os-volume_attachments/f91fc1ad-01df-4111-9f05-1240f48b63e3 => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:54:30.021525 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a7f50eed-cc9a-4d23-87b7-f766aa8b28a4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:30.022169 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-a7f50eed-cc9a-4d23-87b7-f766aa8b28a4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:30.032020 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a7f50eed-cc9a-4d23-87b7-f766aa8b28a4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:30.032504 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a7f50eed-cc9a-4d23-87b7-f766aa8b28a4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:30.032935 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a7f50eed-cc9a-4d23-87b7-f766aa8b28a4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:30.033672 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a7f50eed-cc9a-4d23-87b7-f766aa8b28a4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:30.034154 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a7f50eed-cc9a-4d23-87b7-f766aa8b28a4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:30.034549 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a7f50eed-cc9a-4d23-87b7-f766aa8b28a4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:30.211693 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-a7f50eed-cc9a-4d23-87b7-f766aa8b28a4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:30.215455 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:30.221129 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a7f50eed-cc9a-4d23-87b7-f766aa8b28a4 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1728 microversion: 2.1 time: 0.204389 Aug 31 09:54:30.222099 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 289/565] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:30 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1728 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:30.245060 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-53c70435-7c77-4468-a1e6-369f0225ba34 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:30.245665 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-53c70435-7c77-4468-a1e6-369f0225ba34 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:30.252315 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-53c70435-7c77-4468-a1e6-369f0225ba34 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:30.253411 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-53c70435-7c77-4468-a1e6-369f0225ba34 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:30.253805 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-53c70435-7c77-4468-a1e6-369f0225ba34 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:30.254574 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-53c70435-7c77-4468-a1e6-369f0225ba34 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:30.255024 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-53c70435-7c77-4468-a1e6-369f0225ba34 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:30.255542 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-53c70435-7c77-4468-a1e6-369f0225ba34 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:30.352243 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-53c70435-7c77-4468-a1e6-369f0225ba34 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112020 Aug 31 09:54:30.352836 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 277/566] 10.222.0.13 () {58 vars in 1275 bytes} [Wed Aug 31 09:54:30 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:54:30.770291 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-9eb21bcb-151c-4acb-8523-d66125301a52 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:30.771700 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-9eb21bcb-151c-4acb-8523-d66125301a52 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:30.785926 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9eb21bcb-151c-4acb-8523-d66125301a52 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:30.786640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9eb21bcb-151c-4acb-8523-d66125301a52 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:30.787438 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9eb21bcb-151c-4acb-8523-d66125301a52 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:30.788666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9eb21bcb-151c-4acb-8523-d66125301a52 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:30.789568 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9eb21bcb-151c-4acb-8523-d66125301a52 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:30.790322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9eb21bcb-151c-4acb-8523-d66125301a52 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:31.352642 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-9eb21bcb-151c-4acb-8523-d66125301a52 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:31.365662 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-9eb21bcb-151c-4acb-8523-d66125301a52 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085" status: 200 len: 1514 microversion: 2.1 time: 0.600778 Aug 31 09:54:31.366925 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 290/567] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:30 2022] GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085 => generated 1514 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:31.477238 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-30d0c80c-2618-4e4b-92ed-a6eae742a4ed req-56638a27-3810-4f81-a79c-125ef9492754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eef9aa55-0ea3-48de-b97b-b20c8bef0085", "name": "network-vif-deleted", "tag": "7a6232d6-44ce-4f87-bd9d-73e5a1b1d1ad"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:31.507965 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-30d0c80c-2618-4e4b-92ed-a6eae742a4ed req-56638a27-3810-4f81-a79c-125ef9492754 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:31.508803 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-30d0c80c-2618-4e4b-92ed-a6eae742a4ed req-56638a27-3810-4f81-a79c-125ef9492754 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:31.511545 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-30d0c80c-2618-4e4b-92ed-a6eae742a4ed req-56638a27-3810-4f81-a79c-125ef9492754 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:31.532130 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-30d0c80c-2618-4e4b-92ed-a6eae742a4ed req-56638a27-3810-4f81-a79c-125ef9492754 service nova] Creating event network-vif-deleted:7a6232d6-44ce-4f87-bd9d-73e5a1b1d1ad for instance eef9aa55-0ea3-48de-b97b-b20c8bef0085 on hv-cinder-84496 Aug 31 09:54:31.539030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-30d0c80c-2618-4e4b-92ed-a6eae742a4ed req-56638a27-3810-4f81-a79c-125ef9492754 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073405 Aug 31 09:54:31.540393 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 278/568] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:54:31.820283 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-f750388b-2b69-4648-8873-91ab078685e0 req-a7cf34ca-0485-4ab5-81fd-4f6f3c764ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad92550c-f29b-4f97-9511-a2f1ffa98e3e", "tag": "ebfc41b8-372f-4c67-97e3-7caa675975ac"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:31.832196 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-f750388b-2b69-4648-8873-91ab078685e0 req-a7cf34ca-0485-4ab5-81fd-4f6f3c764ec3 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:31.832689 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-f750388b-2b69-4648-8873-91ab078685e0 req-a7cf34ca-0485-4ab5-81fd-4f6f3c764ec3 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:31.833117 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-f750388b-2b69-4648-8873-91ab078685e0 req-a7cf34ca-0485-4ab5-81fd-4f6f3c764ec3 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:31.845954 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-f750388b-2b69-4648-8873-91ab078685e0 req-a7cf34ca-0485-4ab5-81fd-4f6f3c764ec3 service nova] Creating event network-changed:ebfc41b8-372f-4c67-97e3-7caa675975ac for instance ad92550c-f29b-4f97-9511-a2f1ffa98e3e on hv-cinder-84496 Aug 31 09:54:31.858216 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-f750388b-2b69-4648-8873-91ab078685e0 req-a7cf34ca-0485-4ab5-81fd-4f6f3c764ec3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111889 Aug 31 09:54:31.859162 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 291/569] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:54:32.136684 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-dc9e259a-bc1e-4fa6-a51b-b6e7a7804238 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:32.144227 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dc9e259a-bc1e-4fa6-a51b-b6e7a7804238 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:32.145071 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dc9e259a-bc1e-4fa6-a51b-b6e7a7804238 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:32.145621 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dc9e259a-bc1e-4fa6-a51b-b6e7a7804238 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:32.172734 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-dc9e259a-bc1e-4fa6-a51b-b6e7a7804238 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Going to try to stop instance {{(pid=127171) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 09:54:32.239108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-dc9e259a-bc1e-4fa6-a51b-b6e7a7804238 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "POST /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8/action" status: 202 len: 0 microversion: 2.1 time: 0.106098 Aug 31 09:54:32.240351 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 279/570] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 31 09:54:32 2022] POST /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:54:32.250407 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-cb2c6d6a-37fd-40be-b5ac-8f52852f0b43 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:32.251501 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-cb2c6d6a-37fd-40be-b5ac-8f52852f0b43 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:32.258137 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb2c6d6a-37fd-40be-b5ac-8f52852f0b43 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:32.258703 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb2c6d6a-37fd-40be-b5ac-8f52852f0b43 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:32.259312 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb2c6d6a-37fd-40be-b5ac-8f52852f0b43 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:32.260016 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb2c6d6a-37fd-40be-b5ac-8f52852f0b43 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:32.260459 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb2c6d6a-37fd-40be-b5ac-8f52852f0b43 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:32.260871 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb2c6d6a-37fd-40be-b5ac-8f52852f0b43 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:32.390754 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-776cc97b-b4a8-4cf2-9c88-38c7f3386192 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:32.391525 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-776cc97b-b4a8-4cf2-9c88-38c7f3386192 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:32.399447 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-776cc97b-b4a8-4cf2-9c88-38c7f3386192 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:32.399947 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-776cc97b-b4a8-4cf2-9c88-38c7f3386192 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:32.400386 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-776cc97b-b4a8-4cf2-9c88-38c7f3386192 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:32.401481 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-776cc97b-b4a8-4cf2-9c88-38c7f3386192 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:32.401800 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-776cc97b-b4a8-4cf2-9c88-38c7f3386192 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:32.402227 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-776cc97b-b4a8-4cf2-9c88-38c7f3386192 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:32.408429 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-cb2c6d6a-37fd-40be-b5ac-8f52852f0b43 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:32.419052 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-cb2c6d6a-37fd-40be-b5ac-8f52852f0b43 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1678 microversion: 2.1 time: 0.173933 Aug 31 09:54:32.420628 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 292/571] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:32 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:32.438527 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-776cc97b-b4a8-4cf2-9c88-38c7f3386192 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:32.439014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-776cc97b-b4a8-4cf2-9c88-38c7f3386192 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:32.439449 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-776cc97b-b4a8-4cf2-9c88-38c7f3386192 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:32.440553 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.objects.instance [None req-776cc97b-b4a8-4cf2-9c88-38c7f3386192 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lazy-loading 'fault' on Instance uuid eef9aa55-0ea3-48de-b97b-b20c8bef0085 {{(pid=127171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:54:32.501056 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-776cc97b-b4a8-4cf2-9c88-38c7f3386192 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62009b582dd480198ceca6f41e255c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8336bd8ac0c4600a25261e1af19a7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:32.511083 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-776cc97b-b4a8-4cf2-9c88-38c7f3386192 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085" status: 200 len: 1309 microversion: 2.1 time: 0.125040 Aug 31 09:54:32.513431 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 280/572] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:32 2022] GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085 => generated 1309 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:33.442953 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-612aba00-63ce-48a5-a977-8401f9b23823 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:33.443582 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-612aba00-63ce-48a5-a977-8401f9b23823 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:33.449971 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-612aba00-63ce-48a5-a977-8401f9b23823 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:33.450666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-612aba00-63ce-48a5-a977-8401f9b23823 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:33.450951 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-612aba00-63ce-48a5-a977-8401f9b23823 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:33.451647 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-612aba00-63ce-48a5-a977-8401f9b23823 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:33.452092 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-612aba00-63ce-48a5-a977-8401f9b23823 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:33.452509 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-612aba00-63ce-48a5-a977-8401f9b23823 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:33.532887 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-cb4ef516-25dd-4567-95a3-dc93bd45d146 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:33.533598 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-cb4ef516-25dd-4567-95a3-dc93bd45d146 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] [instance: eef9aa55-0ea3-48de-b97b-b20c8bef0085] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:33.540914 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cb4ef516-25dd-4567-95a3-dc93bd45d146 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:33.541420 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cb4ef516-25dd-4567-95a3-dc93bd45d146 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:33.541859 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cb4ef516-25dd-4567-95a3-dc93bd45d146 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:33.542649 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cb4ef516-25dd-4567-95a3-dc93bd45d146 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:33.543446 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cb4ef516-25dd-4567-95a3-dc93bd45d146 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:33.543446 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cb4ef516-25dd-4567-95a3-dc93bd45d146 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:33.558159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.wsgi [None req-cb4ef516-25dd-4567-95a3-dc93bd45d146 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] HTTP exception thrown: Instance eef9aa55-0ea3-48de-b97b-b20c8bef0085 could not be found. Aug 31 09:54:33.560108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-cb4ef516-25dd-4567-95a3-dc93bd45d146 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Request method failure captured: Aug 31 09:54:33.560108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: request: GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085 HTTP/1.1 Aug 31 09:54:33.560108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept: application/json Aug 31 09:54:33.560108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept-Encoding: identity Aug 31 09:54:33.560108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Connection: close Aug 31 09:54:33.560108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Length: 0 Aug 31 09:54:33.560108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Type: application/json Aug 31 09:54:33.560108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Host: 10.222.0.13 Aug 31 09:54:33.560108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Openstack-System-Scope: None Aug 31 09:54:33.560108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: User-Agent: python-urllib3/1.26.12 Aug 31 09:54:33.560108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Auth-Token: gAAAAABjDy8-E5n9VPC8j3EctfzCzZhJmFGTzEpA931HbjHet2Sz4xkl52tf6c5XbUenhQbMXqK7MidEI_CNkm0I5HMSfM4_wVTv7ww_YMPqKROCA_1YBI_bfAZ-zCzs1Bozc4-64NrreH9Lx55mzbupYcYijwDcXZ0hA6rBHpkh940MUo7TATA Aug 31 09:54:33.560108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Id: None Aug 31 09:54:33.560108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Name: None Aug 31 09:54:33.560108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Identity-Status: Confirmed Aug 31 09:54:33.560108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Is-Admin-Project: True Aug 31 09:54:33.560108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Id: default Aug 31 09:54:33.560108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Name: Default Aug 31 09:54:33.560108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Id: f8336bd8ac0c4600a25261e1af19a7df Aug 31 09:54:33.560108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Name: tempest-VolumesSnapshotTestJSON-105813715 Aug 31 09:54:33.560108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Role: member,reader Aug 31 09:54:33.560108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Roles: member,reader Aug 31 09:54:33.562202 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f8336bd8ac0c4600a25261e1af19a7df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f8336bd8ac0c4600a25261e1af19a7df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f8336bd8ac0c4600a25261e1af19a7df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f8336bd8ac0c4600a25261e1af19a7df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:54:33.562202 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant: tempest-VolumesSnapshotTestJSON-105813715 Aug 31 09:54:33.562202 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Id: f8336bd8ac0c4600a25261e1af19a7df Aug 31 09:54:33.562202 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-105813715 Aug 31 09:54:33.562202 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User: tempest-VolumesSnapshotTestJSON-105813715-project Aug 31 09:54:33.562202 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Id: default Aug 31 09:54:33.562202 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Name: Default Aug 31 09:54:33.562202 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Id: f62009b582dd480198ceca6f41e255c2 Aug 31 09:54:33.562202 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Name: tempest-VolumesSnapshotTestJSON-105813715-project Aug 31 09:54:33.562202 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: method: > Aug 31 09:54:33.562202 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: exception: Instance eef9aa55-0ea3-48de-b97b-b20c8bef0085 could not be found. Aug 31 09:54:33.562202 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: action_args: {'id': 'eef9aa55-0ea3-48de-b97b-b20c8bef0085'} Aug 31 09:54:33.563117 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:54:33.563117 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:54:33.563117 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:54:33.563117 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:54:33.563117 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:54:33.563117 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:54:33.563117 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:54:33.563117 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:54:33.563117 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:54:33.563117 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:54:33.563117 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eef9aa55-0ea3-48de-b97b-b20c8bef0085 could not be found. Aug 31 09:54:33.563117 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:54:33.563117 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:54:33.563117 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:54:33.563117 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:54:33.563117 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:54:33.563117 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:54:33.563117 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:54:33.563117 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:54:33.563117 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:54:33.565620 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:54:33.565620 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:54:33.565620 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:54:33.565620 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:54:33.565620 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:54:33.565620 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:54:33.565620 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:54:33.565620 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eef9aa55-0ea3-48de-b97b-b20c8bef0085 could not be found. Aug 31 09:54:33.565620 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:54:33.565620 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:54:33.565620 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:54:33.565620 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:54:33.565620 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:54:33.565620 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:54:33.565620 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:54:33.565620 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:54:33.565620 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eef9aa55-0ea3-48de-b97b-b20c8bef0085 could not be found. Aug 31 09:54:33.565620 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:54:33.567609 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-cb4ef516-25dd-4567-95a3-dc93bd45d146 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] Returning 404 to user: Instance eef9aa55-0ea3-48de-b97b-b20c8bef0085 could not be found. {{(pid=127171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:54:33.567609 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-cb4ef516-25dd-4567-95a3-dc93bd45d146 tempest-VolumesSnapshotTestJSON-105813715 tempest-VolumesSnapshotTestJSON-105813715-project] 10.222.0.13 "GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085" status: 404 len: 111 microversion: 2.1 time: 0.032569 Aug 31 09:54:33.567609 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 281/573] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:33 2022] GET /compute/v2.1/servers/eef9aa55-0ea3-48de-b97b-b20c8bef0085 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 09:54:33.611601 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-612aba00-63ce-48a5-a977-8401f9b23823 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:33.623564 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-612aba00-63ce-48a5-a977-8401f9b23823 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1678 microversion: 2.1 time: 0.185418 Aug 31 09:54:33.624172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 293/574] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:33 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1678 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:33.879590 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-6c398a28-63e2-4c07-b39e-abed544b0cb8 req-78c60d68-b7aa-40c7-8b3a-77c87168dd31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad92550c-f29b-4f97-9511-a2f1ffa98e3e", "tag": "ebfc41b8-372f-4c67-97e3-7caa675975ac"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:33.889281 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-6c398a28-63e2-4c07-b39e-abed544b0cb8 req-78c60d68-b7aa-40c7-8b3a-77c87168dd31 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:33.889822 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-6c398a28-63e2-4c07-b39e-abed544b0cb8 req-78c60d68-b7aa-40c7-8b3a-77c87168dd31 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:33.890244 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-6c398a28-63e2-4c07-b39e-abed544b0cb8 req-78c60d68-b7aa-40c7-8b3a-77c87168dd31 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:33.904831 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-6c398a28-63e2-4c07-b39e-abed544b0cb8 req-78c60d68-b7aa-40c7-8b3a-77c87168dd31 service nova] Creating event network-changed:ebfc41b8-372f-4c67-97e3-7caa675975ac for instance ad92550c-f29b-4f97-9511-a2f1ffa98e3e on hv-cinder-84496 Aug 31 09:54:33.910061 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-6c398a28-63e2-4c07-b39e-abed544b0cb8 req-78c60d68-b7aa-40c7-8b3a-77c87168dd31 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039152 Aug 31 09:54:33.910869 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 282/575] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:54:34.650610 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-3cacba0d-aecf-4390-ad29-77eed901aa93 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:34.651221 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-3cacba0d-aecf-4390-ad29-77eed901aa93 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:34.658379 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3cacba0d-aecf-4390-ad29-77eed901aa93 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:34.658852 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3cacba0d-aecf-4390-ad29-77eed901aa93 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:34.660226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3cacba0d-aecf-4390-ad29-77eed901aa93 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:34.660963 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3cacba0d-aecf-4390-ad29-77eed901aa93 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:34.661425 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3cacba0d-aecf-4390-ad29-77eed901aa93 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:34.661839 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3cacba0d-aecf-4390-ad29-77eed901aa93 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:34.791828 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-3cacba0d-aecf-4390-ad29-77eed901aa93 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:34.799656 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-3cacba0d-aecf-4390-ad29-77eed901aa93 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1678 microversion: 2.1 time: 0.156944 Aug 31 09:54:34.800244 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 294/576] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:34 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:35.822030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-7a17c979-a9c1-47b9-8cb0-09c73e68b93b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:35.822727 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-7a17c979-a9c1-47b9-8cb0-09c73e68b93b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:35.828924 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7a17c979-a9c1-47b9-8cb0-09c73e68b93b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:35.829427 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7a17c979-a9c1-47b9-8cb0-09c73e68b93b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:35.829863 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7a17c979-a9c1-47b9-8cb0-09c73e68b93b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:35.830545 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7a17c979-a9c1-47b9-8cb0-09c73e68b93b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:35.831047 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7a17c979-a9c1-47b9-8cb0-09c73e68b93b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:35.831510 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7a17c979-a9c1-47b9-8cb0-09c73e68b93b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:35.969620 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7a17c979-a9c1-47b9-8cb0-09c73e68b93b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:35.979213 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-7a17c979-a9c1-47b9-8cb0-09c73e68b93b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1678 microversion: 2.1 time: 0.161934 Aug 31 09:54:35.979866 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 283/577] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:35 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:37.002735 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-68562564-d45f-4878-8efe-ecc830a32394 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:37.005198 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-68562564-d45f-4878-8efe-ecc830a32394 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:37.010465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-68562564-d45f-4878-8efe-ecc830a32394 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:37.010946 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-68562564-d45f-4878-8efe-ecc830a32394 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:37.011373 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-68562564-d45f-4878-8efe-ecc830a32394 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:37.012054 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-68562564-d45f-4878-8efe-ecc830a32394 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:37.012501 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-68562564-d45f-4878-8efe-ecc830a32394 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:37.012912 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-68562564-d45f-4878-8efe-ecc830a32394 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:37.148086 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-68562564-d45f-4878-8efe-ecc830a32394 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:37.156221 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-68562564-d45f-4878-8efe-ecc830a32394 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1678 microversion: 2.1 time: 0.158098 Aug 31 09:54:37.156810 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 295/578] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:36 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:38.179344 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-8c5e7008-de2f-4ab7-8945-4946749bee92 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:38.179966 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-8c5e7008-de2f-4ab7-8945-4946749bee92 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:38.186748 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8c5e7008-de2f-4ab7-8945-4946749bee92 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:38.187279 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8c5e7008-de2f-4ab7-8945-4946749bee92 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:38.187673 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8c5e7008-de2f-4ab7-8945-4946749bee92 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:38.188379 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8c5e7008-de2f-4ab7-8945-4946749bee92 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:38.189254 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8c5e7008-de2f-4ab7-8945-4946749bee92 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:38.189254 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8c5e7008-de2f-4ab7-8945-4946749bee92 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:38.335777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-8c5e7008-de2f-4ab7-8945-4946749bee92 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:38.343775 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-8c5e7008-de2f-4ab7-8945-4946749bee92 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1678 microversion: 2.1 time: 0.169095 Aug 31 09:54:38.344350 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 284/579] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:38 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:39.369628 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-2be09e2f-c62b-4c77-84f0-4626fc635cf0 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:39.370237 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-2be09e2f-c62b-4c77-84f0-4626fc635cf0 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:39.377422 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2be09e2f-c62b-4c77-84f0-4626fc635cf0 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:39.378078 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2be09e2f-c62b-4c77-84f0-4626fc635cf0 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:39.378520 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2be09e2f-c62b-4c77-84f0-4626fc635cf0 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:39.379251 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2be09e2f-c62b-4c77-84f0-4626fc635cf0 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:39.379833 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2be09e2f-c62b-4c77-84f0-4626fc635cf0 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:39.380258 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2be09e2f-c62b-4c77-84f0-4626fc635cf0 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:39.529684 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-2be09e2f-c62b-4c77-84f0-4626fc635cf0 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:39.539202 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-2be09e2f-c62b-4c77-84f0-4626fc635cf0 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1678 microversion: 2.1 time: 0.174453 Aug 31 09:54:39.539975 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 296/580] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:39 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:40.562461 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-b663e9ce-4632-471f-9e6f-be85b7b7d808 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:40.563204 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-b663e9ce-4632-471f-9e6f-be85b7b7d808 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:40.570097 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b663e9ce-4632-471f-9e6f-be85b7b7d808 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:40.570639 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b663e9ce-4632-471f-9e6f-be85b7b7d808 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:40.571069 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b663e9ce-4632-471f-9e6f-be85b7b7d808 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:40.571781 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b663e9ce-4632-471f-9e6f-be85b7b7d808 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:40.572233 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b663e9ce-4632-471f-9e6f-be85b7b7d808 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:40.572664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b663e9ce-4632-471f-9e6f-be85b7b7d808 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:40.711974 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b663e9ce-4632-471f-9e6f-be85b7b7d808 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:40.720106 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-b663e9ce-4632-471f-9e6f-be85b7b7d808 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1678 microversion: 2.1 time: 0.161762 Aug 31 09:54:40.720692 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 285/581] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:40 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:54:41.740874 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-243359cd-2d17-4c25-a7c6-313e70654db8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:41.741610 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-243359cd-2d17-4c25-a7c6-313e70654db8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:41.748534 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-243359cd-2d17-4c25-a7c6-313e70654db8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:41.749021 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-243359cd-2d17-4c25-a7c6-313e70654db8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:41.749484 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-243359cd-2d17-4c25-a7c6-313e70654db8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:41.750193 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-243359cd-2d17-4c25-a7c6-313e70654db8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:41.750651 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-243359cd-2d17-4c25-a7c6-313e70654db8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:41.751075 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-243359cd-2d17-4c25-a7c6-313e70654db8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:41.896681 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-243359cd-2d17-4c25-a7c6-313e70654db8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:41.904857 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-243359cd-2d17-4c25-a7c6-313e70654db8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1678 microversion: 2.1 time: 0.168326 Aug 31 09:54:41.905453 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 297/582] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:41 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:42.926772 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-b2fc89de-7e11-4d23-b6c3-a99b19049e7f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:42.927719 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-b2fc89de-7e11-4d23-b6c3-a99b19049e7f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:42.934191 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b2fc89de-7e11-4d23-b6c3-a99b19049e7f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:42.934749 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b2fc89de-7e11-4d23-b6c3-a99b19049e7f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:42.935246 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b2fc89de-7e11-4d23-b6c3-a99b19049e7f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:42.935936 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b2fc89de-7e11-4d23-b6c3-a99b19049e7f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:42.936386 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b2fc89de-7e11-4d23-b6c3-a99b19049e7f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:42.936800 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b2fc89de-7e11-4d23-b6c3-a99b19049e7f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:43.097165 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b2fc89de-7e11-4d23-b6c3-a99b19049e7f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:43.105757 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-b2fc89de-7e11-4d23-b6c3-a99b19049e7f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1678 microversion: 2.1 time: 0.183109 Aug 31 09:54:43.106251 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 286/583] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:42 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:54:44.132199 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-654c3f8c-792b-4001-880d-93db502a55f3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:44.132861 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-654c3f8c-792b-4001-880d-93db502a55f3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:44.135649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:44.141152 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-654c3f8c-792b-4001-880d-93db502a55f3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:44.141763 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-654c3f8c-792b-4001-880d-93db502a55f3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:44.142108 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-654c3f8c-792b-4001-880d-93db502a55f3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:44.142804 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-654c3f8c-792b-4001-880d-93db502a55f3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:44.143356 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-654c3f8c-792b-4001-880d-93db502a55f3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:44.144063 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-654c3f8c-792b-4001-880d-93db502a55f3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:44.318407 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-654c3f8c-792b-4001-880d-93db502a55f3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:44.326777 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-654c3f8c-792b-4001-880d-93db502a55f3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1678 microversion: 2.1 time: 0.198402 Aug 31 09:54:44.337440 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 298/584] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:44 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1678 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:45.349647 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-4e46c559-99bd-43b4-89d0-907573b98ebc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:45.350198 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-4e46c559-99bd-43b4-89d0-907573b98ebc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:45.356539 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4e46c559-99bd-43b4-89d0-907573b98ebc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:45.357023 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4e46c559-99bd-43b4-89d0-907573b98ebc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:45.357485 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4e46c559-99bd-43b4-89d0-907573b98ebc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:45.358179 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4e46c559-99bd-43b4-89d0-907573b98ebc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:45.358631 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4e46c559-99bd-43b4-89d0-907573b98ebc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:45.359053 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4e46c559-99bd-43b4-89d0-907573b98ebc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:45.374902 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:45.494734 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-4e46c559-99bd-43b4-89d0-907573b98ebc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:45.502138 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-4e46c559-99bd-43b4-89d0-907573b98ebc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1678 microversion: 2.1 time: 0.157270 Aug 31 09:54:45.502724 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 287/585] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:45 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:46.524056 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-3bfa70fb-8fef-433e-bf03-6166b05df4c5 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:46.524653 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-3bfa70fb-8fef-433e-bf03-6166b05df4c5 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:46.532132 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3bfa70fb-8fef-433e-bf03-6166b05df4c5 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:46.532616 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3bfa70fb-8fef-433e-bf03-6166b05df4c5 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:46.533045 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3bfa70fb-8fef-433e-bf03-6166b05df4c5 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:46.533781 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3bfa70fb-8fef-433e-bf03-6166b05df4c5 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:46.534915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3bfa70fb-8fef-433e-bf03-6166b05df4c5 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:46.535334 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3bfa70fb-8fef-433e-bf03-6166b05df4c5 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:46.685839 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-3bfa70fb-8fef-433e-bf03-6166b05df4c5 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:46.694402 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-3bfa70fb-8fef-433e-bf03-6166b05df4c5 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1678 microversion: 2.1 time: 0.174218 Aug 31 09:54:46.694983 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 299/586] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:46 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:47.715447 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-2a6f2e10-8d01-4c94-810f-1f10d2c7810e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:47.716082 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-2a6f2e10-8d01-4c94-810f-1f10d2c7810e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:47.722850 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2a6f2e10-8d01-4c94-810f-1f10d2c7810e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:47.723341 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2a6f2e10-8d01-4c94-810f-1f10d2c7810e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:47.723779 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2a6f2e10-8d01-4c94-810f-1f10d2c7810e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:47.724482 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2a6f2e10-8d01-4c94-810f-1f10d2c7810e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:47.724931 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2a6f2e10-8d01-4c94-810f-1f10d2c7810e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:47.725350 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2a6f2e10-8d01-4c94-810f-1f10d2c7810e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:47.861964 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2a6f2e10-8d01-4c94-810f-1f10d2c7810e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:47.871039 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-2a6f2e10-8d01-4c94-810f-1f10d2c7810e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1678 microversion: 2.1 time: 0.159493 Aug 31 09:54:47.871712 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 288/587] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:47 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:54:48.892565 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a7aac601-d3bb-4d2a-baef-3d071d4d7edc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:48.893130 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-a7aac601-d3bb-4d2a-baef-3d071d4d7edc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:48.900324 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a7aac601-d3bb-4d2a-baef-3d071d4d7edc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:48.900799 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a7aac601-d3bb-4d2a-baef-3d071d4d7edc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:48.901223 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a7aac601-d3bb-4d2a-baef-3d071d4d7edc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:48.901933 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a7aac601-d3bb-4d2a-baef-3d071d4d7edc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:48.902373 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a7aac601-d3bb-4d2a-baef-3d071d4d7edc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:48.902782 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a7aac601-d3bb-4d2a-baef-3d071d4d7edc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:49.037079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-a7aac601-d3bb-4d2a-baef-3d071d4d7edc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:49.044834 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a7aac601-d3bb-4d2a-baef-3d071d4d7edc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1678 microversion: 2.1 time: 0.156280 Aug 31 09:54:49.045418 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 300/588] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:48 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:50.066611 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-b71ccaab-cee8-44a4-bbb6-8e48ac5557be tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:50.067223 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-b71ccaab-cee8-44a4-bbb6-8e48ac5557be tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:50.073940 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b71ccaab-cee8-44a4-bbb6-8e48ac5557be tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:50.074424 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b71ccaab-cee8-44a4-bbb6-8e48ac5557be tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:50.075147 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b71ccaab-cee8-44a4-bbb6-8e48ac5557be tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:50.075850 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b71ccaab-cee8-44a4-bbb6-8e48ac5557be tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:50.076298 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b71ccaab-cee8-44a4-bbb6-8e48ac5557be tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:50.076715 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b71ccaab-cee8-44a4-bbb6-8e48ac5557be tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:50.224824 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b71ccaab-cee8-44a4-bbb6-8e48ac5557be tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:50.232602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-b71ccaab-cee8-44a4-bbb6-8e48ac5557be tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1678 microversion: 2.1 time: 0.170072 Aug 31 09:54:50.233116 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 289/589] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:50 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:51.254162 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-12023263-33b2-4a77-9a98-ba7f2aa1e341 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:51.254802 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-12023263-33b2-4a77-9a98-ba7f2aa1e341 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:51.261611 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-12023263-33b2-4a77-9a98-ba7f2aa1e341 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:51.262094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-12023263-33b2-4a77-9a98-ba7f2aa1e341 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:51.262523 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-12023263-33b2-4a77-9a98-ba7f2aa1e341 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:51.263239 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-12023263-33b2-4a77-9a98-ba7f2aa1e341 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:51.263669 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-12023263-33b2-4a77-9a98-ba7f2aa1e341 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:51.264085 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-12023263-33b2-4a77-9a98-ba7f2aa1e341 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:51.408853 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-12023263-33b2-4a77-9a98-ba7f2aa1e341 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:51.417165 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-12023263-33b2-4a77-9a98-ba7f2aa1e341 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1678 microversion: 2.1 time: 0.167594 Aug 31 09:54:51.417779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 301/590] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:51 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:52.438278 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-4c4de9a7-6470-4f4f-84b8-74f0b2abaaf3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:52.438899 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-4c4de9a7-6470-4f4f-84b8-74f0b2abaaf3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:52.442040 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 09:54:52.442188 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Wed Aug 31 09:54:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 (ip 10.222.0.13) !!! Aug 31 09:54:52.449065 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4c4de9a7-6470-4f4f-84b8-74f0b2abaaf3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:52.449577 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4c4de9a7-6470-4f4f-84b8-74f0b2abaaf3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:52.450009 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4c4de9a7-6470-4f4f-84b8-74f0b2abaaf3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:52.450698 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4c4de9a7-6470-4f4f-84b8-74f0b2abaaf3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:52.451145 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4c4de9a7-6470-4f4f-84b8-74f0b2abaaf3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:52.451561 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4c4de9a7-6470-4f4f-84b8-74f0b2abaaf3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:52.599523 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-4c4de9a7-6470-4f4f-84b8-74f0b2abaaf3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:52.607454 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-4c4de9a7-6470-4f4f-84b8-74f0b2abaaf3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1678 microversion: 2.1 time: 0.172973 Aug 31 09:54:52.608025 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 290/591] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:52 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:53.631054 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-7ba7e246-7660-4218-af01-61dbb842df9c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:53.631869 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-7ba7e246-7660-4218-af01-61dbb842df9c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:53.641446 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7ba7e246-7660-4218-af01-61dbb842df9c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:53.642154 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7ba7e246-7660-4218-af01-61dbb842df9c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:53.642841 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7ba7e246-7660-4218-af01-61dbb842df9c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:53.644070 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7ba7e246-7660-4218-af01-61dbb842df9c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:53.645072 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7ba7e246-7660-4218-af01-61dbb842df9c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:53.645947 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7ba7e246-7660-4218-af01-61dbb842df9c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:53.788269 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-7ba7e246-7660-4218-af01-61dbb842df9c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:53.796180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-7ba7e246-7660-4218-af01-61dbb842df9c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1655 microversion: 2.1 time: 0.169777 Aug 31 09:54:53.796760 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 302/592] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:53 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1655 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:53.818222 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-d3816de5-8be5-4d93-9f7b-78418c47a150 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:53.825659 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d3816de5-8be5-4d93-9f7b-78418c47a150 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:53.826128 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d3816de5-8be5-4d93-9f7b-78418c47a150 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:53.826561 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d3816de5-8be5-4d93-9f7b-78418c47a150 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:53.851216 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-d3816de5-8be5-4d93-9f7b-78418c47a150 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Going to try to start instance {{(pid=127171) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 09:54:53.898272 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-d3816de5-8be5-4d93-9f7b-78418c47a150 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "POST /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8/action" status: 202 len: 0 microversion: 2.1 time: 0.084357 Aug 31 09:54:53.898959 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 291/593] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 31 09:54:53 2022] POST /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:54:53.907979 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-88effada-8f25-4448-9d1a-d0076ff147a8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:53.909690 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-88effada-8f25-4448-9d1a-d0076ff147a8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:53.918424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-88effada-8f25-4448-9d1a-d0076ff147a8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:53.918913 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-88effada-8f25-4448-9d1a-d0076ff147a8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:53.919343 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-88effada-8f25-4448-9d1a-d0076ff147a8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:53.920228 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-88effada-8f25-4448-9d1a-d0076ff147a8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:53.920979 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-88effada-8f25-4448-9d1a-d0076ff147a8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:53.921656 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-88effada-8f25-4448-9d1a-d0076ff147a8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:54.067986 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-88effada-8f25-4448-9d1a-d0076ff147a8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:54.081348 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-88effada-8f25-4448-9d1a-d0076ff147a8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1664 microversion: 2.1 time: 0.177168 Aug 31 09:54:54.082198 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 303/594] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:53 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1664 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:55.107447 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-ed84a55e-f5d1-4b68-9ef8-303d2411983c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:55.108148 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-ed84a55e-f5d1-4b68-9ef8-303d2411983c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:55.114759 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ed84a55e-f5d1-4b68-9ef8-303d2411983c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:55.115245 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ed84a55e-f5d1-4b68-9ef8-303d2411983c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:55.115676 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ed84a55e-f5d1-4b68-9ef8-303d2411983c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:55.116370 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ed84a55e-f5d1-4b68-9ef8-303d2411983c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:55.116816 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ed84a55e-f5d1-4b68-9ef8-303d2411983c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:55.117233 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ed84a55e-f5d1-4b68-9ef8-303d2411983c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:55.253832 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-ed84a55e-f5d1-4b68-9ef8-303d2411983c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:55.261577 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-ed84a55e-f5d1-4b68-9ef8-303d2411983c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1664 microversion: 2.1 time: 0.158815 Aug 31 09:54:55.262153 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 292/595] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:55 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:56.283053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-bf25c966-fc77-4264-aead-d7edd154a6a9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:56.283630 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-bf25c966-fc77-4264-aead-d7edd154a6a9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:56.291023 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bf25c966-fc77-4264-aead-d7edd154a6a9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:56.291500 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bf25c966-fc77-4264-aead-d7edd154a6a9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:56.291933 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bf25c966-fc77-4264-aead-d7edd154a6a9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:56.292617 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bf25c966-fc77-4264-aead-d7edd154a6a9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:56.293065 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bf25c966-fc77-4264-aead-d7edd154a6a9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:56.293512 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bf25c966-fc77-4264-aead-d7edd154a6a9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:56.439654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-bf25c966-fc77-4264-aead-d7edd154a6a9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:56.449433 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-bf25c966-fc77-4264-aead-d7edd154a6a9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1668 microversion: 2.1 time: 0.170275 Aug 31 09:54:56.450025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 304/596] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:56 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1668 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:18.982441 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=41 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:18.983620 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:19.223676 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-a7c9f29e-4caf-483f-b7b3-17bf16ca2d3f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:19.224163 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-a7c9f29e-4caf-483f-b7b3-17bf16ca2d3f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:19.230516 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a7c9f29e-4caf-483f-b7b3-17bf16ca2d3f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:19.230925 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a7c9f29e-4caf-483f-b7b3-17bf16ca2d3f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:19.231353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a7c9f29e-4caf-483f-b7b3-17bf16ca2d3f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:19.232049 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a7c9f29e-4caf-483f-b7b3-17bf16ca2d3f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:19.232493 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a7c9f29e-4caf-483f-b7b3-17bf16ca2d3f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:19.232910 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a7c9f29e-4caf-483f-b7b3-17bf16ca2d3f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:19.257367 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-a7c9f29e-4caf-483f-b7b3-17bf16ca2d3f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31/ips" status: 200 len: 148 microversion: 2.1 time: 0.280549 Aug 31 09:55:19.258039 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 293/597] 10.222.0.13 () {58 vars in 1248 bytes} [Wed Aug 31 09:55:18 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31/ips => generated 148 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:19.269894 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a0727cc0-724d-4136-9815-f27978b67e91 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca3487c4-dad6-48ff-991c-23ed1c520b99"}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:19.272252 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-a0727cc0-724d-4136-9815-f27978b67e91 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:19.274479 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=13 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:19.275140 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=86 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:19.281019 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a0727cc0-724d-4136-9815-f27978b67e91 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:19.281541 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a0727cc0-724d-4136-9815-f27978b67e91 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:19.281980 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a0727cc0-724d-4136-9815-f27978b67e91 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:19.282678 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a0727cc0-724d-4136-9815-f27978b67e91 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:19.283131 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a0727cc0-724d-4136-9815-f27978b67e91 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:19.283553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a0727cc0-724d-4136-9815-f27978b67e91 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:19.367785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-a0727cc0-724d-4136-9815-f27978b67e91 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] HTTP exception thrown: Invalid volume: volume ca3487c4-dad6-48ff-991c-23ed1c520b99 is already attached to instances: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 Aug 31 09:55:19.369515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a0727cc0-724d-4136-9815-f27978b67e91 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Request method failure captured: Aug 31 09:55:19.369515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: POST /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31/os-volume_attachments HTTP/1.1 Aug 31 09:55:19.369515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 09:55:19.369515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 09:55:19.369515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 09:55:19.369515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 74 Aug 31 09:55:19.369515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 09:55:19.369515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 09:55:19.369515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 09:55:19.369515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 09:55:19.369515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy6sN1dq8bwJPS_jK4T_eY89XY484BzJuR68dlflJc6VvZgYE_FtzceTKQW1kiHPXFi1h_ZI_jnv2y63cuWWAmCtmFfvmGj6lmJqh816MDH_lQt4Qw0fH63qKXCoQUNRNnOITiuKYSI6cXUru5wJe9L6kAmQya7lhE-_AhxPVCJKUbM Aug 31 09:55:19.369515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 09:55:19.369515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 09:55:19.369515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 09:55:19.369515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 09:55:19.369515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 09:55:19.369515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 09:55:19.369515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:55:19.369515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:55:19.369515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 09:55:19.369515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 09:55:19.371175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5ed9143757584694a5139ada8dbd5570"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:55:19.371175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:55:19.371175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:55:19.371175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:55:19.371175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:55:19.371175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 09:55:19.371175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 09:55:19.371175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: 25b4233e5f0e41bf99b3fb3f5f6229c9 Aug 31 09:55:19.371175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:55:19.371175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Aug 31 09:55:19.371175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {"volumeAttachment": {"volumeId": "ca3487c4-dad6-48ff-991c-23ed1c520b99"}} Aug 31 09:55:19.371175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 09:55:19.372383 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Invalid volume: volume ca3487c4-dad6-48ff-991c-23ed1c520b99 is already attached to instances: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 Aug 31 09:55:19.372383 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'server_id': '2f64ad4a-cdde-4c1e-ac02-3977cdadef31', 'body': {'volumeAttachment': {'volumeId': 'ca3487c4-dad6-48ff-991c-23ed1c520b99'}}} Aug 31 09:55:19.372383 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:55:19.372383 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:19.372383 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 09:55:19.372383 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 09:55:19.372383 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 09:55:19.372383 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 09:55:19.372383 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 09:55:19.372383 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 09:55:19.372383 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 09:55:19.372383 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 09:55:19.372383 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 09:55:19.372383 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 09:55:19.372383 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ca3487c4-dad6-48ff-991c-23ed1c520b99 is already attached to instances: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 Aug 31 09:55:19.372383 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:55:19.372383 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:19.372383 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:55:19.372383 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:19.373916 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:19.373916 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:19.373916 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:55:19.373916 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:55:19.373916 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:55:19.373916 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:55:19.373916 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:55:19.373916 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:55:19.373916 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:55:19.373916 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:55:19.373916 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:55:19.373916 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:55:19.373916 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 09:55:19.373916 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 09:55:19.373916 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ca3487c4-dad6-48ff-991c-23ed1c520b99 is already attached to instances: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 Aug 31 09:55:19.373916 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:55:19.373916 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:19.373916 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:55:19.373916 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:19.373916 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:19.375487 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:19.375487 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:55:19.375487 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:55:19.375487 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ca3487c4-dad6-48ff-991c-23ed1c520b99 is already attached to instances: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 Aug 31 09:55:19.375487 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:55:19.375487 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a0727cc0-724d-4136-9815-f27978b67e91 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Returning 400 to user: Invalid volume: volume ca3487c4-dad6-48ff-991c-23ed1c520b99 is already attached to instances: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:55:19.375487 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a0727cc0-724d-4136-9815-f27978b67e91 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "POST /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105479 Aug 31 09:55:19.375487 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 305/598] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 31 09:55:19 2022] POST /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 09:55:19.380143 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-534da13c-a0b9-4f88-b96c-b8ac059f061a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:19.380637 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-534da13c-a0b9-4f88-b96c-b8ac059f061a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:19.386516 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-534da13c-a0b9-4f88-b96c-b8ac059f061a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:19.386993 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-534da13c-a0b9-4f88-b96c-b8ac059f061a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:19.387423 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-534da13c-a0b9-4f88-b96c-b8ac059f061a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:19.388103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-534da13c-a0b9-4f88-b96c-b8ac059f061a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:19.388552 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-534da13c-a0b9-4f88-b96c-b8ac059f061a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:19.388971 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-534da13c-a0b9-4f88-b96c-b8ac059f061a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:19.415494 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-534da13c-a0b9-4f88-b96c-b8ac059f061a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Going to try to terminate instance {{(pid=127171) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:55:19.492528 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-534da13c-a0b9-4f88-b96c-b8ac059f061a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 204 len: 0 microversion: 2.1 time: 0.116121 Aug 31 09:55:19.493026 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 294/599] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 09:55:19 2022] DELETE /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:55:19.501175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-267dbeba-9348-4028-8e21-62f86c8725ea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:19.502079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-267dbeba-9348-4028-8e21-62f86c8725ea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:19.509846 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-267dbeba-9348-4028-8e21-62f86c8725ea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:19.510328 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-267dbeba-9348-4028-8e21-62f86c8725ea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:19.510757 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-267dbeba-9348-4028-8e21-62f86c8725ea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:19.511443 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-267dbeba-9348-4028-8e21-62f86c8725ea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:19.511889 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-267dbeba-9348-4028-8e21-62f86c8725ea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:19.512305 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-267dbeba-9348-4028-8e21-62f86c8725ea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:19.647230 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-267dbeba-9348-4028-8e21-62f86c8725ea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:19.655036 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-267dbeba-9348-4028-8e21-62f86c8725ea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 200 len: 1680 microversion: 2.1 time: 0.157651 Aug 31 09:55:19.655596 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 306/600] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:19 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:20.677799 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-d6785a78-5fe3-4378-a5b6-46604e8bc6a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:20.678508 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-d6785a78-5fe3-4378-a5b6-46604e8bc6a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:20.690117 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d6785a78-5fe3-4378-a5b6-46604e8bc6a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:20.690771 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d6785a78-5fe3-4378-a5b6-46604e8bc6a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:20.691411 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d6785a78-5fe3-4378-a5b6-46604e8bc6a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:20.691795 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d6785a78-5fe3-4378-a5b6-46604e8bc6a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:20.692240 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d6785a78-5fe3-4378-a5b6-46604e8bc6a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:20.692655 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d6785a78-5fe3-4378-a5b6-46604e8bc6a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:20.837817 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-d6785a78-5fe3-4378-a5b6-46604e8bc6a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:20.847784 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-d6785a78-5fe3-4378-a5b6-46604e8bc6a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 200 len: 1680 microversion: 2.1 time: 0.174524 Aug 31 09:55:20.848820 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 295/601] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:20 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:21.872360 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-6197e1dc-e2c6-46b8-80e6-5e7b7ade7af7 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:21.873278 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-6197e1dc-e2c6-46b8-80e6-5e7b7ade7af7 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:21.883137 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6197e1dc-e2c6-46b8-80e6-5e7b7ade7af7 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:21.883757 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6197e1dc-e2c6-46b8-80e6-5e7b7ade7af7 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:21.884299 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6197e1dc-e2c6-46b8-80e6-5e7b7ade7af7 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:21.885163 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6197e1dc-e2c6-46b8-80e6-5e7b7ade7af7 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:21.885633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6197e1dc-e2c6-46b8-80e6-5e7b7ade7af7 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:21.886057 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6197e1dc-e2c6-46b8-80e6-5e7b7ade7af7 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:22.051582 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-6197e1dc-e2c6-46b8-80e6-5e7b7ade7af7 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:22.066362 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-6197e1dc-e2c6-46b8-80e6-5e7b7ade7af7 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 200 len: 1680 microversion: 2.1 time: 0.197429 Aug 31 09:55:22.067395 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 307/602] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:21 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 1680 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:23.099641 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-7eba629e-e637-44f8-8461-581cec131dda tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:23.102005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-7eba629e-e637-44f8-8461-581cec131dda tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:23.114499 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7eba629e-e637-44f8-8461-581cec131dda tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:23.115790 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7eba629e-e637-44f8-8461-581cec131dda tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:23.117156 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7eba629e-e637-44f8-8461-581cec131dda tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:23.118613 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7eba629e-e637-44f8-8461-581cec131dda tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:23.120029 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7eba629e-e637-44f8-8461-581cec131dda tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:23.121138 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7eba629e-e637-44f8-8461-581cec131dda tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:23.152891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-f015253b-2592-4ec1-87c9-875dea2e1a90 req-fafb8891-45d2-46fd-8c94-7e5483f42b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f64ad4a-cdde-4c1e-ac02-3977cdadef31", "name": "network-vif-deleted", "tag": "f6f8c737-1493-4a89-b98d-7b911611cfc5"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:23.175684 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-f015253b-2592-4ec1-87c9-875dea2e1a90 req-fafb8891-45d2-46fd-8c94-7e5483f42b2e service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:23.176694 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-f015253b-2592-4ec1-87c9-875dea2e1a90 req-fafb8891-45d2-46fd-8c94-7e5483f42b2e service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:23.178536 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-f015253b-2592-4ec1-87c9-875dea2e1a90 req-fafb8891-45d2-46fd-8c94-7e5483f42b2e service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:23.208060 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-f015253b-2592-4ec1-87c9-875dea2e1a90 req-fafb8891-45d2-46fd-8c94-7e5483f42b2e service nova] Creating event network-vif-deleted:f6f8c737-1493-4a89-b98d-7b911611cfc5 for instance 2f64ad4a-cdde-4c1e-ac02-3977cdadef31 on hv-cinder-84496 Aug 31 09:55:23.221259 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-f015253b-2592-4ec1-87c9-875dea2e1a90 req-fafb8891-45d2-46fd-8c94-7e5483f42b2e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079263 Aug 31 09:55:23.226329 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 308/603] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:55:23.265142 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7eba629e-e637-44f8-8461-581cec131dda tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:23.282980 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-7eba629e-e637-44f8-8461-581cec131dda tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 200 len: 1612 microversion: 2.1 time: 0.190055 Aug 31 09:55:23.301542 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 296/604] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:23 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 1612 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:55:24.328280 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-411574fc-e8f6-431b-8fd1-4fe55bd87574 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:24.331245 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-411574fc-e8f6-431b-8fd1-4fe55bd87574 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:24.343894 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-411574fc-e8f6-431b-8fd1-4fe55bd87574 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:24.345158 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-411574fc-e8f6-431b-8fd1-4fe55bd87574 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:24.346215 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-411574fc-e8f6-431b-8fd1-4fe55bd87574 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:24.349086 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-411574fc-e8f6-431b-8fd1-4fe55bd87574 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:24.350560 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-411574fc-e8f6-431b-8fd1-4fe55bd87574 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:24.352127 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-411574fc-e8f6-431b-8fd1-4fe55bd87574 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:24.383761 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-411574fc-e8f6-431b-8fd1-4fe55bd87574 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] HTTP exception thrown: Instance 2f64ad4a-cdde-4c1e-ac02-3977cdadef31 could not be found. Aug 31 09:55:24.387449 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-411574fc-e8f6-431b-8fd1-4fe55bd87574 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Request method failure captured: Aug 31 09:55:24.387449 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 HTTP/1.1 Aug 31 09:55:24.387449 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 09:55:24.387449 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 09:55:24.387449 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 09:55:24.387449 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 09:55:24.387449 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 09:55:24.387449 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 09:55:24.387449 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 09:55:24.387449 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 09:55:24.387449 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy6sN1dq8bwJPS_jK4T_eY89XY484BzJuR68dlflJc6VvZgYE_FtzceTKQW1kiHPXFi1h_ZI_jnv2y63cuWWAmCtmFfvmGj6lmJqh816MDH_lQt4Qw0fH63qKXCoQUNRNnOITiuKYSI6cXUru5wJe9L6kAmQya7lhE-_AhxPVCJKUbM Aug 31 09:55:24.387449 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 09:55:24.387449 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 09:55:24.387449 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 09:55:24.387449 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 09:55:24.387449 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 09:55:24.387449 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 09:55:24.387449 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:55:24.387449 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:55:24.387449 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 09:55:24.387449 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 09:55:24.390256 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5ed9143757584694a5139ada8dbd5570"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:55:24.390256 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:55:24.390256 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:55:24.390256 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:55:24.390256 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:55:24.390256 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 09:55:24.390256 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 09:55:24.390256 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: 25b4233e5f0e41bf99b3fb3f5f6229c9 Aug 31 09:55:24.390256 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:55:24.390256 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 09:55:24.390256 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Instance 2f64ad4a-cdde-4c1e-ac02-3977cdadef31 could not be found. Aug 31 09:55:24.390256 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': '2f64ad4a-cdde-4c1e-ac02-3977cdadef31'} Aug 31 09:55:24.392053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:55:24.392053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:24.392053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:55:24.392053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:55:24.392053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:55:24.392053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:55:24.392053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:55:24.392053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:55:24.392053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:55:24.392053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:55:24.392053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f64ad4a-cdde-4c1e-ac02-3977cdadef31 could not be found. Aug 31 09:55:24.392053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:55:24.392053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:24.392053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:55:24.392053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:24.392053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:24.392053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:24.392053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:55:24.392053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:55:24.392053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:55:24.395275 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:55:24.395275 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:55:24.395275 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:55:24.395275 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:55:24.395275 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:55:24.395275 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:55:24.395275 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:55:24.395275 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f64ad4a-cdde-4c1e-ac02-3977cdadef31 could not be found. Aug 31 09:55:24.395275 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:55:24.395275 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:24.395275 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:55:24.395275 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:24.395275 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:24.395275 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:24.395275 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:55:24.395275 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:55:24.395275 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f64ad4a-cdde-4c1e-ac02-3977cdadef31 could not be found. Aug 31 09:55:24.395275 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:55:24.400048 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-411574fc-e8f6-431b-8fd1-4fe55bd87574 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Returning 404 to user: Instance 2f64ad4a-cdde-4c1e-ac02-3977cdadef31 could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:55:24.400048 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-411574fc-e8f6-431b-8fd1-4fe55bd87574 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 404 len: 111 microversion: 2.1 time: 0.072112 Aug 31 09:55:24.402386 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 309/605] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:24 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:55:24.414756 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-151f8535-a4f7-44ac-b934-19171f7c7a67 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '.version_select at 0x7f5503eb7820>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:24.451086 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-151f8535-a4f7-44ac-b934-19171f7c7a67 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-288177047" status: 202 len: 0 microversion: 2.1 time: 0.047632 Aug 31 09:55:24.451769 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 297/606] 10.222.0.13 () {58 vars in 1218 bytes} [Wed Aug 31 09:55:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-288177047 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:55:25.490311 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-0935ee1b-9ef7-424a-a583-c8f541d5e689 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:25.490919 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-0935ee1b-9ef7-424a-a583-c8f541d5e689 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:25.498296 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0935ee1b-9ef7-424a-a583-c8f541d5e689 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:25.498791 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0935ee1b-9ef7-424a-a583-c8f541d5e689 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:25.499225 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0935ee1b-9ef7-424a-a583-c8f541d5e689 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:25.499937 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0935ee1b-9ef7-424a-a583-c8f541d5e689 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:25.500385 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0935ee1b-9ef7-424a-a583-c8f541d5e689 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:25.500968 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0935ee1b-9ef7-424a-a583-c8f541d5e689 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:25.618387 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.objects.instance [None req-0935ee1b-9ef7-424a-a583-c8f541d5e689 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lazy-loading 'services' on Instance uuid cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 {{(pid=127170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:55:25.701196 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-0935ee1b-9ef7-424a-a583-c8f541d5e689 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3/os-volume_attachments/ca3487c4-dad6-48ff-991c-23ed1c520b99" status: 202 len: 0 microversion: 2.1 time: 0.215477 Aug 31 09:55:25.701664 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 310/607] 10.222.0.13 () {58 vars in 1416 bytes} [Wed Aug 31 09:55:25 2022] DELETE /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3/os-volume_attachments/ca3487c4-dad6-48ff-991c-23ed1c520b99 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 09:55:25.711668 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-6b8be2c9-7a01-4fcc-888e-7b0ab6405cc8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:25.714037 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-6b8be2c9-7a01-4fcc-888e-7b0ab6405cc8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:25.722926 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6b8be2c9-7a01-4fcc-888e-7b0ab6405cc8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:25.723443 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6b8be2c9-7a01-4fcc-888e-7b0ab6405cc8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:25.723873 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6b8be2c9-7a01-4fcc-888e-7b0ab6405cc8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:25.724594 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6b8be2c9-7a01-4fcc-888e-7b0ab6405cc8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:25.725055 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6b8be2c9-7a01-4fcc-888e-7b0ab6405cc8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:25.725531 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6b8be2c9-7a01-4fcc-888e-7b0ab6405cc8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:25.760116 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-6b8be2c9-7a01-4fcc-888e-7b0ab6405cc8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052939 Aug 31 09:55:25.760969 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 298/608] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 31 09:55:25 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:26.777331 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f3feba59-095f-42cd-bb0c-13cf2685eaea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:26.779688 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-f3feba59-095f-42cd-bb0c-13cf2685eaea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:26.786485 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f3feba59-095f-42cd-bb0c-13cf2685eaea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:26.786977 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f3feba59-095f-42cd-bb0c-13cf2685eaea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:26.787427 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f3feba59-095f-42cd-bb0c-13cf2685eaea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:26.788122 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f3feba59-095f-42cd-bb0c-13cf2685eaea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:26.788570 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f3feba59-095f-42cd-bb0c-13cf2685eaea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:26.788993 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f3feba59-095f-42cd-bb0c-13cf2685eaea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:26.822967 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-f3feba59-095f-42cd-bb0c-13cf2685eaea tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050544 Aug 31 09:55:26.823561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 311/609] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 31 09:55:26 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:27.838389 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-1568ce48-7546-4582-a5a6-cbf0cdf185ab tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:27.840526 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-1568ce48-7546-4582-a5a6-cbf0cdf185ab tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:27.851358 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1568ce48-7546-4582-a5a6-cbf0cdf185ab tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:27.852234 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1568ce48-7546-4582-a5a6-cbf0cdf185ab tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:27.852908 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1568ce48-7546-4582-a5a6-cbf0cdf185ab tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:27.853985 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1568ce48-7546-4582-a5a6-cbf0cdf185ab tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:27.854602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1568ce48-7546-4582-a5a6-cbf0cdf185ab tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:27.855127 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1568ce48-7546-4582-a5a6-cbf0cdf185ab tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:27.899347 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-1568ce48-7546-4582-a5a6-cbf0cdf185ab tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064659 Aug 31 09:55:27.900383 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 299/610] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 31 09:55:27 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 09:55:27.969451 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-dfc29f85-7bcd-44d0-bb43-10bfe793b2dd tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:27.970160 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-dfc29f85-7bcd-44d0-bb43-10bfe793b2dd tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:27.978409 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-dfc29f85-7bcd-44d0-bb43-10bfe793b2dd tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:27.978895 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-dfc29f85-7bcd-44d0-bb43-10bfe793b2dd tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:27.979407 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-dfc29f85-7bcd-44d0-bb43-10bfe793b2dd tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:27.980234 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-dfc29f85-7bcd-44d0-bb43-10bfe793b2dd tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:27.981052 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-dfc29f85-7bcd-44d0-bb43-10bfe793b2dd tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:27.981851 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-dfc29f85-7bcd-44d0-bb43-10bfe793b2dd tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:28.020387 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-dfc29f85-7bcd-44d0-bb43-10bfe793b2dd tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Going to try to terminate instance {{(pid=127170) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:55:28.126273 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-dfc29f85-7bcd-44d0-bb43-10bfe793b2dd tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 204 len: 0 microversion: 2.1 time: 0.160285 Aug 31 09:55:28.126887 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 312/611] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 09:55:27 2022] DELETE /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 09:55:28.136061 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-790e901e-e12e-43c2-b69a-8a82508c281f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:28.136661 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-790e901e-e12e-43c2-b69a-8a82508c281f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:28.142880 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-790e901e-e12e-43c2-b69a-8a82508c281f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:28.143401 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-790e901e-e12e-43c2-b69a-8a82508c281f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:28.143837 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-790e901e-e12e-43c2-b69a-8a82508c281f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:28.144521 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-790e901e-e12e-43c2-b69a-8a82508c281f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:28.144965 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-790e901e-e12e-43c2-b69a-8a82508c281f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:28.145377 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-790e901e-e12e-43c2-b69a-8a82508c281f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:28.292579 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-790e901e-e12e-43c2-b69a-8a82508c281f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:28.302222 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-790e901e-e12e-43c2-b69a-8a82508c281f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1682 microversion: 2.1 time: 0.170422 Aug 31 09:55:28.302810 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 300/612] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:28 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:55:29.326708 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-072db407-7c3c-481d-96e5-c6d6570dd8fb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:29.327647 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-072db407-7c3c-481d-96e5-c6d6570dd8fb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:29.338891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-072db407-7c3c-481d-96e5-c6d6570dd8fb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:29.339918 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-072db407-7c3c-481d-96e5-c6d6570dd8fb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:29.340627 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-072db407-7c3c-481d-96e5-c6d6570dd8fb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:29.342015 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-072db407-7c3c-481d-96e5-c6d6570dd8fb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:29.342846 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-072db407-7c3c-481d-96e5-c6d6570dd8fb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:29.343599 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-072db407-7c3c-481d-96e5-c6d6570dd8fb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:29.516822 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-072db407-7c3c-481d-96e5-c6d6570dd8fb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:29.525519 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-072db407-7c3c-481d-96e5-c6d6570dd8fb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1682 microversion: 2.1 time: 0.204419 Aug 31 09:55:29.526117 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 313/613] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:29 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1682 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:30.395971 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-0dc8f61f-6f40-4742-97e4-6b9f27db95ae req-d75aa9b1-7794-4460-bdc6-9a4356976069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3", "name": "network-vif-deleted", "tag": "cc06604f-efa3-4b8c-a2d5-693ffb365876"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:30.415432 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-0dc8f61f-6f40-4742-97e4-6b9f27db95ae req-d75aa9b1-7794-4460-bdc6-9a4356976069 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:30.416193 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-0dc8f61f-6f40-4742-97e4-6b9f27db95ae req-d75aa9b1-7794-4460-bdc6-9a4356976069 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:30.416966 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-0dc8f61f-6f40-4742-97e4-6b9f27db95ae req-d75aa9b1-7794-4460-bdc6-9a4356976069 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:30.446560 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-0dc8f61f-6f40-4742-97e4-6b9f27db95ae req-d75aa9b1-7794-4460-bdc6-9a4356976069 service nova] Creating event network-vif-deleted:cc06604f-efa3-4b8c-a2d5-693ffb365876 for instance cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 on hv-cinder-84496 Aug 31 09:55:30.458356 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-0dc8f61f-6f40-4742-97e4-6b9f27db95ae req-d75aa9b1-7794-4460-bdc6-9a4356976069 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070805 Aug 31 09:55:30.459179 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 301/614] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:30.552328 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-8b196b45-60d9-41e0-a212-906fab24b855 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:30.553516 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-8b196b45-60d9-41e0-a212-906fab24b855 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:30.568388 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8b196b45-60d9-41e0-a212-906fab24b855 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:30.569792 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8b196b45-60d9-41e0-a212-906fab24b855 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:30.571362 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8b196b45-60d9-41e0-a212-906fab24b855 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:30.573019 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8b196b45-60d9-41e0-a212-906fab24b855 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:30.573875 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8b196b45-60d9-41e0-a212-906fab24b855 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:30.574645 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8b196b45-60d9-41e0-a212-906fab24b855 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:30.682112 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-8b196b45-60d9-41e0-a212-906fab24b855 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:30.692400 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-8b196b45-60d9-41e0-a212-906fab24b855 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 200 len: 1327 microversion: 2.1 time: 0.148113 Aug 31 09:55:30.693358 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 314/615] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:30 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 1327 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:31.734411 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-3b4e983d-a810-4f77-a125-e82c9ff16963 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:31.735601 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-3b4e983d-a810-4f77-a125-e82c9ff16963 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:31.745809 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3b4e983d-a810-4f77-a125-e82c9ff16963 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:31.746470 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3b4e983d-a810-4f77-a125-e82c9ff16963 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:31.747186 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3b4e983d-a810-4f77-a125-e82c9ff16963 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:31.748009 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3b4e983d-a810-4f77-a125-e82c9ff16963 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:31.748574 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3b4e983d-a810-4f77-a125-e82c9ff16963 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:31.749125 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3b4e983d-a810-4f77-a125-e82c9ff16963 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:31.766886 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.wsgi [None req-3b4e983d-a810-4f77-a125-e82c9ff16963 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] HTTP exception thrown: Instance cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 could not be found. Aug 31 09:55:31.769199 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-3b4e983d-a810-4f77-a125-e82c9ff16963 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Request method failure captured: Aug 31 09:55:31.769199 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: request: GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 HTTP/1.1 Aug 31 09:55:31.769199 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept: application/json Aug 31 09:55:31.769199 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept-Encoding: identity Aug 31 09:55:31.769199 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Connection: close Aug 31 09:55:31.769199 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Length: 0 Aug 31 09:55:31.769199 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Type: application/json Aug 31 09:55:31.769199 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Host: 10.222.0.13 Aug 31 09:55:31.769199 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Openstack-System-Scope: None Aug 31 09:55:31.769199 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: User-Agent: python-urllib3/1.26.12 Aug 31 09:55:31.769199 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Auth-Token: gAAAAABjDy6sN1dq8bwJPS_jK4T_eY89XY484BzJuR68dlflJc6VvZgYE_FtzceTKQW1kiHPXFi1h_ZI_jnv2y63cuWWAmCtmFfvmGj6lmJqh816MDH_lQt4Qw0fH63qKXCoQUNRNnOITiuKYSI6cXUru5wJe9L6kAmQya7lhE-_AhxPVCJKUbM Aug 31 09:55:31.769199 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Id: None Aug 31 09:55:31.769199 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Name: None Aug 31 09:55:31.769199 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Identity-Status: Confirmed Aug 31 09:55:31.769199 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Is-Admin-Project: True Aug 31 09:55:31.769199 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Id: default Aug 31 09:55:31.769199 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Name: Default Aug 31 09:55:31.769199 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:55:31.769199 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:55:31.769199 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Role: member,reader Aug 31 09:55:31.769199 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Roles: member,reader Aug 31 09:55:31.771932 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5ed9143757584694a5139ada8dbd5570"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:55:31.771932 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:55:31.771932 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:55:31.771932 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:55:31.771932 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:55:31.771932 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Id: default Aug 31 09:55:31.771932 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Name: Default Aug 31 09:55:31.771932 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Id: 25b4233e5f0e41bf99b3fb3f5f6229c9 Aug 31 09:55:31.771932 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Name: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:55:31.771932 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: method: > Aug 31 09:55:31.771932 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: exception: Instance cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 could not be found. Aug 31 09:55:31.771932 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: action_args: {'id': 'cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3'} Aug 31 09:55:31.773299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:55:31.773299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:31.773299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:55:31.773299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:55:31.773299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:55:31.773299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:55:31.773299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:55:31.773299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:55:31.773299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:55:31.773299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:55:31.773299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 could not be found. Aug 31 09:55:31.773299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:55:31.773299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:31.773299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:55:31.773299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:31.773299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:31.773299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:31.773299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:55:31.773299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:55:31.773299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:55:31.775580 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:55:31.775580 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:55:31.775580 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:55:31.775580 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:55:31.775580 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:55:31.775580 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:55:31.775580 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:55:31.775580 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 could not be found. Aug 31 09:55:31.775580 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:55:31.775580 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:31.775580 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:55:31.775580 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:31.775580 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:31.775580 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:31.775580 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:55:31.775580 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:55:31.775580 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 could not be found. Aug 31 09:55:31.775580 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:55:31.779006 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-3b4e983d-a810-4f77-a125-e82c9ff16963 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Returning 404 to user: Instance cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 could not be found. {{(pid=127171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:55:31.779006 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-3b4e983d-a810-4f77-a125-e82c9ff16963 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 404 len: 111 microversion: 2.1 time: 0.042784 Aug 31 09:55:31.779006 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 302/616] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:31 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 09:55:31.784690 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-24a7742b-fa57-4484-aaa0-dd506de73439 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '.version_select at 0x7f5503eec4c0>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:31.790319 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR oslo.messaging._drivers.impl_rabbit [None req-24a7742b-fa57-4484-aaa0-dd506de73439 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [d200a3dd-84f2-4054-8bb4-7fba0ac3f2aa] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 09:55:32.800380 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO oslo.messaging._drivers.impl_rabbit [None req-24a7742b-fa57-4484-aaa0-dd506de73439 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [d200a3dd-84f2-4054-8bb4-7fba0ac3f2aa] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 46056. Aug 31 09:55:32.828917 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-24a7742b-fa57-4484-aaa0-dd506de73439 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1792117911" status: 202 len: 0 microversion: 2.1 time: 1.048919 Aug 31 09:55:32.829847 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 315/617] 10.222.0.13 () {58 vars in 1221 bytes} [Wed Aug 31 09:55:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1792117911 => generated 0 bytes in 1051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 09:55:33.588918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-23e5e696-b083-4fd0-b5e5-59c717650644 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Action: 'create', calling method: .version_select at 0x7f5503e07700>, body: {"keypair": {"name": "tempest-keypair-1451865228", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/KjJiU7WJ2itgjQXom/qGmV49yVYPMOZNtljvVxNhGO5qeBa4dIytTHmHXP8Swt87j4nF/yOsxd5ybxWERXdE/rV0err0uR69IVj1uJ2pICJJejw1L4Ny482k/qT8aAw=="}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:33.606866 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-23e5e696-b083-4fd0-b5e5-59c717650644 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Getting quotas for project 5ed9143757584694a5139ada8dbd5570. Resources: {'key_pairs'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:55:33.611523 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-23e5e696-b083-4fd0-b5e5-59c717650644 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Getting quotas for user 25b4233e5f0e41bf99b3fb3f5f6229c9 and project 5ed9143757584694a5139ada8dbd5570. Resources: {'key_pairs'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:55:33.640477 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-23e5e696-b083-4fd0-b5e5-59c717650644 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057571 Aug 31 09:55:33.641283 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 303/618] 10.222.0.13 () {60 vars in 1159 bytes} [Wed Aug 31 09:55:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:55:35.429022 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-9411402e-3bd6-4137-8d17-37bdec143248 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-268500885", "imageRef": "8e078bb9-f274-4984-8128-d31407d49604", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ba3d70db-89a3-4a36-91f7-576971d6cd3f"}], "security_groups": [{"name": "tempest-securitygroup--815293029"}], "key_name": "tempest-keypair-1451865228", "user_data": "}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:35.567870 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.network.neutron [None req-9411402e-3bd6-4137-8d17-37bdec143248 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] validate_networks() for [('ba3d70db-89a3-4a36-91f7-576971d6cd3f', None, None, None, None, None)] {{(pid=127170) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:55:36.345322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-9411402e-3bd6-4137-8d17-37bdec143248 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Flavor limits 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:55:36.345775 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-9411402e-3bd6-4137-8d17-37bdec143248 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Image limits 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:55:36.346776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-9411402e-3bd6-4137-8d17-37bdec143248 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Flavor pref 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:55:36.347389 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-9411402e-3bd6-4137-8d17-37bdec143248 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Image pref 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:55:36.347969 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-9411402e-3bd6-4137-8d17-37bdec143248 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:55:36.357912 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9411402e-3bd6-4137-8d17-37bdec143248 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:36.358397 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9411402e-3bd6-4137-8d17-37bdec143248 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:36.358822 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9411402e-3bd6-4137-8d17-37bdec143248 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:36.359555 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9411402e-3bd6-4137-8d17-37bdec143248 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:36.360000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9411402e-3bd6-4137-8d17-37bdec143248 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:36.360422 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9411402e-3bd6-4137-8d17-37bdec143248 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:36.380580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-9411402e-3bd6-4137-8d17-37bdec143248 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Getting quotas for project 5ed9143757584694a5139ada8dbd5570. Resources: {'ram', 'instances', 'cores'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:55:36.385562 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-9411402e-3bd6-4137-8d17-37bdec143248 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Getting quotas for user 25b4233e5f0e41bf99b3fb3f5f6229c9 and project 5ed9143757584694a5139ada8dbd5570. Resources: {'ram', 'instances', 'cores'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:55:36.398636 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-9411402e-3bd6-4137-8d17-37bdec143248 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Going to run 1 instances... {{(pid=127170) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:55:36.401025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-9411402e-3bd6-4137-8d17-37bdec143248 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8e078bb9-f274-4984-8128-d31407d49604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:55:36.453714 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-9411402e-3bd6-4137-8d17-37bdec143248 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.030929 Aug 31 09:55:36.454850 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 316/619] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 31 09:55:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 09:55:36.466698 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-5bf0f635-7f40-42b3-9ea2-ecf30ffe6e22 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:36.467576 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-5bf0f635-7f40-42b3-9ea2-ecf30ffe6e22 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:36.535202 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-5bf0f635-7f40-42b3-9ea2-ecf30ffe6e22 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:36.547744 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-5bf0f635-7f40-42b3-9ea2-ecf30ffe6e22 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3" status: 200 len: 1241 microversion: 2.1 time: 0.085413 Aug 31 09:55:36.548771 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 304/620] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:36 2022] GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:55:37.579625 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-93a2fd15-0653-4e39-a1c1-5db8e0c99bef tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:37.580299 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-93a2fd15-0653-4e39-a1c1-5db8e0c99bef tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:37.588471 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-93a2fd15-0653-4e39-a1c1-5db8e0c99bef tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:37.588963 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-93a2fd15-0653-4e39-a1c1-5db8e0c99bef tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:37.589427 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-93a2fd15-0653-4e39-a1c1-5db8e0c99bef tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:37.590159 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-93a2fd15-0653-4e39-a1c1-5db8e0c99bef tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:37.590612 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-93a2fd15-0653-4e39-a1c1-5db8e0c99bef tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:37.591028 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-93a2fd15-0653-4e39-a1c1-5db8e0c99bef tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:37.673757 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-93a2fd15-0653-4e39-a1c1-5db8e0c99bef tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:37.683814 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-93a2fd15-0653-4e39-a1c1-5db8e0c99bef tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3" status: 200 len: 1293 microversion: 2.1 time: 0.108056 Aug 31 09:55:37.684445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 317/621] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:37 2022] GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3 => generated 1293 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:55:38.158902 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9aa8900c-7f63-45d3-8032-668437d53ead tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:38.160606 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-9aa8900c-7f63-45d3-8032-668437d53ead tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:38.170146 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9aa8900c-7f63-45d3-8032-668437d53ead tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:38.170790 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9aa8900c-7f63-45d3-8032-668437d53ead tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:38.171372 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9aa8900c-7f63-45d3-8032-668437d53ead tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:38.172383 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9aa8900c-7f63-45d3-8032-668437d53ead tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:38.173325 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9aa8900c-7f63-45d3-8032-668437d53ead tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:38.173969 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9aa8900c-7f63-45d3-8032-668437d53ead tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:38.276170 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.objects.instance [None req-9aa8900c-7f63-45d3-8032-668437d53ead tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lazy-loading 'services' on Instance uuid ad92550c-f29b-4f97-9511-a2f1ffa98e3e {{(pid=127171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:55:38.386974 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-9aa8900c-7f63-45d3-8032-668437d53ead tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e/os-volume_attachments/cc9cec97-fb22-4a67-a3a1-340879728ffd" status: 202 len: 0 microversion: 2.1 time: 0.237619 Aug 31 09:55:38.393744 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 305/622] 10.222.0.13 () {58 vars in 1416 bytes} [Wed Aug 31 09:55:38 2022] DELETE /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e/os-volume_attachments/cc9cec97-fb22-4a67-a3a1-340879728ffd => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 09:55:38.405807 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-ad3d38de-f25d-4852-83cd-986bbbea12b3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:38.412310 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-ad3d38de-f25d-4852-83cd-986bbbea12b3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:38.423674 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ad3d38de-f25d-4852-83cd-986bbbea12b3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:38.425104 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ad3d38de-f25d-4852-83cd-986bbbea12b3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:38.425717 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ad3d38de-f25d-4852-83cd-986bbbea12b3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:38.426602 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ad3d38de-f25d-4852-83cd-986bbbea12b3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:38.427322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ad3d38de-f25d-4852-83cd-986bbbea12b3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:38.428058 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ad3d38de-f25d-4852-83cd-986bbbea12b3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:38.469991 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-ad3d38de-f25d-4852-83cd-986bbbea12b3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073726 Aug 31 09:55:38.470524 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 318/623] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 31 09:55:38 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:38.711733 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9a9b3941-6e72-4a61-8455-2b5ac5bc36cc tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:38.712924 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-9a9b3941-6e72-4a61-8455-2b5ac5bc36cc tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:38.725685 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9a9b3941-6e72-4a61-8455-2b5ac5bc36cc tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:38.726451 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9a9b3941-6e72-4a61-8455-2b5ac5bc36cc tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:38.727217 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9a9b3941-6e72-4a61-8455-2b5ac5bc36cc tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:38.728517 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9a9b3941-6e72-4a61-8455-2b5ac5bc36cc tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:38.729290 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9a9b3941-6e72-4a61-8455-2b5ac5bc36cc tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:38.730038 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9a9b3941-6e72-4a61-8455-2b5ac5bc36cc tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:38.835235 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-9a9b3941-6e72-4a61-8455-2b5ac5bc36cc tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:38.847962 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-9a9b3941-6e72-4a61-8455-2b5ac5bc36cc tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3" status: 200 len: 1299 microversion: 2.1 time: 0.143028 Aug 31 09:55:38.848957 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 306/624] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:38 2022] GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3 => generated 1299 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:39.486134 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-009b0c5a-1052-4dc0-85c1-809204522bc3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:39.489136 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-009b0c5a-1052-4dc0-85c1-809204522bc3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:39.497896 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-009b0c5a-1052-4dc0-85c1-809204522bc3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:39.500155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-009b0c5a-1052-4dc0-85c1-809204522bc3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:39.500983 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-009b0c5a-1052-4dc0-85c1-809204522bc3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:39.502546 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-009b0c5a-1052-4dc0-85c1-809204522bc3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:39.503368 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-009b0c5a-1052-4dc0-85c1-809204522bc3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:39.504309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-009b0c5a-1052-4dc0-85c1-809204522bc3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:39.559135 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-009b0c5a-1052-4dc0-85c1-809204522bc3 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076661 Aug 31 09:55:39.560125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 319/625] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 31 09:55:39 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:39.875933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-b19fa624-2667-4e97-a8d4-7b981999557e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:39.877015 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-b19fa624-2667-4e97-a8d4-7b981999557e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:39.888209 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b19fa624-2667-4e97-a8d4-7b981999557e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:39.889107 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b19fa624-2667-4e97-a8d4-7b981999557e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:39.889925 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b19fa624-2667-4e97-a8d4-7b981999557e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:39.891130 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b19fa624-2667-4e97-a8d4-7b981999557e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:39.891930 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b19fa624-2667-4e97-a8d4-7b981999557e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:39.892715 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b19fa624-2667-4e97-a8d4-7b981999557e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:40.034999 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-8e2d6852-2d45-42cb-8667-89f19c8d9e70 req-1a255435-a111-4a2f-81c8-e32da0416227 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3238242-6707-4564-b749-b478f64967f3", "tag": "06438076-47dd-4bdb-a71f-1a49e57a577f"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:40.054927 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-8e2d6852-2d45-42cb-8667-89f19c8d9e70 req-1a255435-a111-4a2f-81c8-e32da0416227 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:40.056012 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-8e2d6852-2d45-42cb-8667-89f19c8d9e70 req-1a255435-a111-4a2f-81c8-e32da0416227 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:40.057501 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-8e2d6852-2d45-42cb-8667-89f19c8d9e70 req-1a255435-a111-4a2f-81c8-e32da0416227 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:40.082113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-8e2d6852-2d45-42cb-8667-89f19c8d9e70 req-1a255435-a111-4a2f-81c8-e32da0416227 service nova] Creating event network-changed:06438076-47dd-4bdb-a71f-1a49e57a577f for instance a3238242-6707-4564-b749-b478f64967f3 on hv-cinder-84496 Aug 31 09:55:40.093730 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-8e2d6852-2d45-42cb-8667-89f19c8d9e70 req-1a255435-a111-4a2f-81c8-e32da0416227 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065398 Aug 31 09:55:40.094870 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 320/626] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:55:40.143067 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b19fa624-2667-4e97-a8d4-7b981999557e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:40.155615 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-b19fa624-2667-4e97-a8d4-7b981999557e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3" status: 200 len: 1366 microversion: 2.1 time: 0.286494 Aug 31 09:55:40.156674 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 307/627] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:39 2022] GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3 => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:55:40.577927 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-d7d94dbe-a4cc-450b-9fa5-17053affc4dc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:40.582331 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-d7d94dbe-a4cc-450b-9fa5-17053affc4dc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:40.595371 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d7d94dbe-a4cc-450b-9fa5-17053affc4dc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:40.596593 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d7d94dbe-a4cc-450b-9fa5-17053affc4dc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:40.597431 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d7d94dbe-a4cc-450b-9fa5-17053affc4dc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:40.598696 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d7d94dbe-a4cc-450b-9fa5-17053affc4dc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:40.599522 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d7d94dbe-a4cc-450b-9fa5-17053affc4dc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:40.600276 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d7d94dbe-a4cc-450b-9fa5-17053affc4dc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:40.650686 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-d7d94dbe-a4cc-450b-9fa5-17053affc4dc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079412 Aug 31 09:55:40.651258 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 321/628] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 31 09:55:40 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 09:55:40.756226 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-1732bf71-d388-43b1-80be-9d497d79527a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:40.756851 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-1732bf71-d388-43b1-80be-9d497d79527a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:40.764705 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1732bf71-d388-43b1-80be-9d497d79527a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:40.765310 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1732bf71-d388-43b1-80be-9d497d79527a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:40.765821 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1732bf71-d388-43b1-80be-9d497d79527a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:40.766618 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1732bf71-d388-43b1-80be-9d497d79527a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:40.767223 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1732bf71-d388-43b1-80be-9d497d79527a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:40.767897 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1732bf71-d388-43b1-80be-9d497d79527a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:40.798664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-1732bf71-d388-43b1-80be-9d497d79527a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Going to try to terminate instance {{(pid=127171) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:55:40.888677 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-1732bf71-d388-43b1-80be-9d497d79527a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 204 len: 0 microversion: 2.1 time: 0.138221 Aug 31 09:55:40.889734 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 308/629] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 09:55:40 2022] DELETE /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:55:40.898246 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-fa530f05-6a7c-43d0-80f3-fcf9c5def768 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:40.899059 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-fa530f05-6a7c-43d0-80f3-fcf9c5def768 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:40.905860 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fa530f05-6a7c-43d0-80f3-fcf9c5def768 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:40.906412 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fa530f05-6a7c-43d0-80f3-fcf9c5def768 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:40.906936 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fa530f05-6a7c-43d0-80f3-fcf9c5def768 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:40.907709 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fa530f05-6a7c-43d0-80f3-fcf9c5def768 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:40.908194 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fa530f05-6a7c-43d0-80f3-fcf9c5def768 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:40.909263 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fa530f05-6a7c-43d0-80f3-fcf9c5def768 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:41.064070 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-fa530f05-6a7c-43d0-80f3-fcf9c5def768 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:41.068477 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:41.074189 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-fa530f05-6a7c-43d0-80f3-fcf9c5def768 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1688 microversion: 2.1 time: 0.179901 Aug 31 09:55:41.074791 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 322/630] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:40 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:41.181872 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-3852fc7f-f072-4352-8aa1-da53cf25da9f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:41.182595 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-3852fc7f-f072-4352-8aa1-da53cf25da9f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:41.188918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3852fc7f-f072-4352-8aa1-da53cf25da9f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:41.189436 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3852fc7f-f072-4352-8aa1-da53cf25da9f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:41.189947 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3852fc7f-f072-4352-8aa1-da53cf25da9f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:41.190634 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3852fc7f-f072-4352-8aa1-da53cf25da9f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:41.191086 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3852fc7f-f072-4352-8aa1-da53cf25da9f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:41.191506 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3852fc7f-f072-4352-8aa1-da53cf25da9f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:41.344197 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-3852fc7f-f072-4352-8aa1-da53cf25da9f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:41.353551 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-3852fc7f-f072-4352-8aa1-da53cf25da9f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3" status: 200 len: 1366 microversion: 2.1 time: 0.175949 Aug 31 09:55:41.354153 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 309/631] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:41 2022] GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:55:42.100273 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-9870753c-0a91-45a9-8633-e2c020ef23bf tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:42.100955 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-9870753c-0a91-45a9-8633-e2c020ef23bf tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:42.108543 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9870753c-0a91-45a9-8633-e2c020ef23bf tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:42.109052 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9870753c-0a91-45a9-8633-e2c020ef23bf tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:42.109603 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9870753c-0a91-45a9-8633-e2c020ef23bf tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:42.110330 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9870753c-0a91-45a9-8633-e2c020ef23bf tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:42.110783 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9870753c-0a91-45a9-8633-e2c020ef23bf tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:42.111212 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9870753c-0a91-45a9-8633-e2c020ef23bf tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:42.273428 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-9870753c-0a91-45a9-8633-e2c020ef23bf tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:42.282089 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-9870753c-0a91-45a9-8633-e2c020ef23bf tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1688 microversion: 2.1 time: 0.189685 Aug 31 09:55:42.282689 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 323/632] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:42 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1688 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:42.375446 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-def4c638-10be-479c-b7c1-65547576fb0a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:42.376157 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-def4c638-10be-479c-b7c1-65547576fb0a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:42.384285 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-def4c638-10be-479c-b7c1-65547576fb0a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:42.384854 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-def4c638-10be-479c-b7c1-65547576fb0a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:42.385329 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-def4c638-10be-479c-b7c1-65547576fb0a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:42.386174 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-def4c638-10be-479c-b7c1-65547576fb0a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:42.386731 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-def4c638-10be-479c-b7c1-65547576fb0a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:42.387278 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-def4c638-10be-479c-b7c1-65547576fb0a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:42.392402 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:42.554251 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-def4c638-10be-479c-b7c1-65547576fb0a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:42.562948 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-def4c638-10be-479c-b7c1-65547576fb0a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3" status: 200 len: 1366 microversion: 2.1 time: 0.191401 Aug 31 09:55:42.563566 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 310/633] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:42 2022] GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:43.317614 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-1190c65c-25b5-48cd-b870-790f49f03493 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:43.318480 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-1190c65c-25b5-48cd-b870-790f49f03493 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:43.327320 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1190c65c-25b5-48cd-b870-790f49f03493 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:43.327879 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1190c65c-25b5-48cd-b870-790f49f03493 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:43.328483 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1190c65c-25b5-48cd-b870-790f49f03493 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:43.329298 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1190c65c-25b5-48cd-b870-790f49f03493 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:43.330062 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1190c65c-25b5-48cd-b870-790f49f03493 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:43.330568 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1190c65c-25b5-48cd-b870-790f49f03493 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:43.502896 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-1190c65c-25b5-48cd-b870-790f49f03493 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:43.516057 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-1190c65c-25b5-48cd-b870-790f49f03493 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1688 microversion: 2.1 time: 0.202934 Aug 31 09:55:43.517757 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 324/634] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:43 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1688 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:55:43.586351 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-b245e047-cdff-4f89-be61-d9a7b974d813 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:43.587191 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-b245e047-cdff-4f89-be61-d9a7b974d813 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:43.595539 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b245e047-cdff-4f89-be61-d9a7b974d813 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:43.596608 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b245e047-cdff-4f89-be61-d9a7b974d813 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:43.597264 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b245e047-cdff-4f89-be61-d9a7b974d813 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:43.598307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b245e047-cdff-4f89-be61-d9a7b974d813 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:43.599004 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b245e047-cdff-4f89-be61-d9a7b974d813 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:43.599500 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b245e047-cdff-4f89-be61-d9a7b974d813 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:43.795857 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b245e047-cdff-4f89-be61-d9a7b974d813 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:43.806185 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-b245e047-cdff-4f89-be61-d9a7b974d813 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3" status: 200 len: 1366 microversion: 2.1 time: 0.223804 Aug 31 09:55:43.807052 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 311/635] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:43 2022] GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:55:44.548364 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-24b4feda-7826-4b35-8ddd-20dd95b7ad68 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:44.549705 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-24b4feda-7826-4b35-8ddd-20dd95b7ad68 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:44.556721 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-24b4feda-7826-4b35-8ddd-20dd95b7ad68 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:44.557211 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-24b4feda-7826-4b35-8ddd-20dd95b7ad68 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:44.557680 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-24b4feda-7826-4b35-8ddd-20dd95b7ad68 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:44.558398 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-24b4feda-7826-4b35-8ddd-20dd95b7ad68 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:44.558855 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-24b4feda-7826-4b35-8ddd-20dd95b7ad68 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:44.559277 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-24b4feda-7826-4b35-8ddd-20dd95b7ad68 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:44.716567 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-24b4feda-7826-4b35-8ddd-20dd95b7ad68 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:44.729038 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-24b4feda-7826-4b35-8ddd-20dd95b7ad68 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1688 microversion: 2.1 time: 0.184521 Aug 31 09:55:44.729945 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 325/636] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:44 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1688 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:55:44.831249 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-cf34da50-e2bc-4f55-8f4e-8e15a7037bf4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:44.832218 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-cf34da50-e2bc-4f55-8f4e-8e15a7037bf4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:44.840601 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cf34da50-e2bc-4f55-8f4e-8e15a7037bf4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:44.841151 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cf34da50-e2bc-4f55-8f4e-8e15a7037bf4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:44.841585 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cf34da50-e2bc-4f55-8f4e-8e15a7037bf4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:44.842434 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cf34da50-e2bc-4f55-8f4e-8e15a7037bf4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:44.842898 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cf34da50-e2bc-4f55-8f4e-8e15a7037bf4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:44.843593 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cf34da50-e2bc-4f55-8f4e-8e15a7037bf4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:45.031943 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-cf34da50-e2bc-4f55-8f4e-8e15a7037bf4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:45.043152 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-cf34da50-e2bc-4f55-8f4e-8e15a7037bf4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3" status: 200 len: 1366 microversion: 2.1 time: 0.216373 Aug 31 09:55:45.043842 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 312/637] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:44 2022] GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:55:45.063978 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-2bc92bca-4515-4019-a658-36f0503abe98 req-7d82d503-2e8f-4bc6-9a7d-9949f4dc8f2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3238242-6707-4564-b749-b478f64967f3", "name": "network-vif-plugged", "status": "completed", "tag": "06438076-47dd-4bdb-a71f-1a49e57a577f"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:45.073827 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-2bc92bca-4515-4019-a658-36f0503abe98 req-7d82d503-2e8f-4bc6-9a7d-9949f4dc8f2c service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:45.074296 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-2bc92bca-4515-4019-a658-36f0503abe98 req-7d82d503-2e8f-4bc6-9a7d-9949f4dc8f2c service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:45.074727 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-2bc92bca-4515-4019-a658-36f0503abe98 req-7d82d503-2e8f-4bc6-9a7d-9949f4dc8f2c service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:45.088672 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-2bc92bca-4515-4019-a658-36f0503abe98 req-7d82d503-2e8f-4bc6-9a7d-9949f4dc8f2c service nova] Creating event network-vif-plugged:06438076-47dd-4bdb-a71f-1a49e57a577f for instance a3238242-6707-4564-b749-b478f64967f3 on hv-cinder-84496 Aug 31 09:55:45.094475 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-2bc92bca-4515-4019-a658-36f0503abe98 req-7d82d503-2e8f-4bc6-9a7d-9949f4dc8f2c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034166 Aug 31 09:55:45.095100 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 326/638] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:45.753458 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-307614b0-6cf6-4d39-9dde-fd3f9a32ffcc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:45.754065 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-307614b0-6cf6-4d39-9dde-fd3f9a32ffcc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:45.760494 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-307614b0-6cf6-4d39-9dde-fd3f9a32ffcc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:45.760989 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-307614b0-6cf6-4d39-9dde-fd3f9a32ffcc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:45.761454 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-307614b0-6cf6-4d39-9dde-fd3f9a32ffcc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:45.762180 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-307614b0-6cf6-4d39-9dde-fd3f9a32ffcc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:45.762632 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-307614b0-6cf6-4d39-9dde-fd3f9a32ffcc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:45.763055 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-307614b0-6cf6-4d39-9dde-fd3f9a32ffcc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:45.911690 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-307614b0-6cf6-4d39-9dde-fd3f9a32ffcc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:45.919931 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-307614b0-6cf6-4d39-9dde-fd3f9a32ffcc tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1688 microversion: 2.1 time: 0.170894 Aug 31 09:55:45.920522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 313/639] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:45 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:55:46.068219 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f7d7a37b-cfd8-444e-ad6d-95a63114dfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:46.069416 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-f7d7a37b-cfd8-444e-ad6d-95a63114dfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:46.081040 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f7d7a37b-cfd8-444e-ad6d-95a63114dfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:46.081945 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f7d7a37b-cfd8-444e-ad6d-95a63114dfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:46.082729 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f7d7a37b-cfd8-444e-ad6d-95a63114dfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:46.083992 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f7d7a37b-cfd8-444e-ad6d-95a63114dfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:46.084819 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f7d7a37b-cfd8-444e-ad6d-95a63114dfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:46.085608 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f7d7a37b-cfd8-444e-ad6d-95a63114dfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:46.260187 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-f7d7a37b-cfd8-444e-ad6d-95a63114dfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:46.270710 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-f7d7a37b-cfd8-444e-ad6d-95a63114dfca tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3" status: 200 len: 1366 microversion: 2.1 time: 0.209416 Aug 31 09:55:46.271312 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 327/640] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:46 2022] GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:55:46.943192 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-4a676f36-3950-42ba-b93c-a849a64c5c92 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:46.943837 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-4a676f36-3950-42ba-b93c-a849a64c5c92 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:46.945790 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=6 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:46.951822 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4a676f36-3950-42ba-b93c-a849a64c5c92 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:46.952317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4a676f36-3950-42ba-b93c-a849a64c5c92 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:46.952751 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4a676f36-3950-42ba-b93c-a849a64c5c92 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:46.953485 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4a676f36-3950-42ba-b93c-a849a64c5c92 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:46.953941 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4a676f36-3950-42ba-b93c-a849a64c5c92 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:46.954479 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4a676f36-3950-42ba-b93c-a849a64c5c92 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:47.139765 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-4a676f36-3950-42ba-b93c-a849a64c5c92 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:47.151360 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-4a676f36-3950-42ba-b93c-a849a64c5c92 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1688 microversion: 2.1 time: 0.212816 Aug 31 09:55:47.151970 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 314/641] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:46 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1688 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:47.292277 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-c2cd9c82-fdfc-41b6-be1a-d8ccfa9fa5f0 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:47.293298 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-c2cd9c82-fdfc-41b6-be1a-d8ccfa9fa5f0 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:47.295756 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=2 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:47.296575 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=6 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:47.305142 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c2cd9c82-fdfc-41b6-be1a-d8ccfa9fa5f0 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:47.305724 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c2cd9c82-fdfc-41b6-be1a-d8ccfa9fa5f0 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:47.306299 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c2cd9c82-fdfc-41b6-be1a-d8ccfa9fa5f0 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:47.307080 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c2cd9c82-fdfc-41b6-be1a-d8ccfa9fa5f0 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:47.307638 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c2cd9c82-fdfc-41b6-be1a-d8ccfa9fa5f0 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:47.308206 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c2cd9c82-fdfc-41b6-be1a-d8ccfa9fa5f0 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:47.493670 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-c2cd9c82-fdfc-41b6-be1a-d8ccfa9fa5f0 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:47.503039 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-c2cd9c82-fdfc-41b6-be1a-d8ccfa9fa5f0 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3" status: 200 len: 1366 microversion: 2.1 time: 0.214906 Aug 31 09:55:47.503851 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 328/642] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:47 2022] GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:55:48.176743 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9949ff1f-3332-4455-bb88-455febeea8ee tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:48.177476 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-9949ff1f-3332-4455-bb88-455febeea8ee tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:48.184438 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9949ff1f-3332-4455-bb88-455febeea8ee tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:48.184922 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9949ff1f-3332-4455-bb88-455febeea8ee tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:48.185609 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9949ff1f-3332-4455-bb88-455febeea8ee tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:48.186323 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9949ff1f-3332-4455-bb88-455febeea8ee tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:48.186773 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9949ff1f-3332-4455-bb88-455febeea8ee tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:48.187196 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9949ff1f-3332-4455-bb88-455febeea8ee tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:48.521990 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-9949ff1f-3332-4455-bb88-455febeea8ee tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:48.526274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-643bff46-bc74-491d-b0a3-c58486c714ec tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:48.526929 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-643bff46-bc74-491d-b0a3-c58486c714ec tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:48.534408 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-643bff46-bc74-491d-b0a3-c58486c714ec tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:48.535000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-643bff46-bc74-491d-b0a3-c58486c714ec tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:48.535519 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-643bff46-bc74-491d-b0a3-c58486c714ec tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:48.536363 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-643bff46-bc74-491d-b0a3-c58486c714ec tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:48.536895 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-643bff46-bc74-491d-b0a3-c58486c714ec tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:48.537145 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-9949ff1f-3332-4455-bb88-455febeea8ee tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1688 microversion: 2.1 time: 0.364850 Aug 31 09:55:48.537444 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-643bff46-bc74-491d-b0a3-c58486c714ec tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:48.538424 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 315/643] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:48 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1688 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:48.762384 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-643bff46-bc74-491d-b0a3-c58486c714ec tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:48.777700 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-643bff46-bc74-491d-b0a3-c58486c714ec tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3" status: 200 len: 1366 microversion: 2.1 time: 0.257089 Aug 31 09:55:48.779767 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 329/644] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:48 2022] GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:49.250572 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-af6d48f7-eec0-4add-9eb3-51016807701c req-5a2dcd05-7481-4e10-9600-98af46732afc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad92550c-f29b-4f97-9511-a2f1ffa98e3e", "name": "network-vif-deleted", "tag": "ebfc41b8-372f-4c67-97e3-7caa675975ac"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:49.260148 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:49.262821 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-af6d48f7-eec0-4add-9eb3-51016807701c req-5a2dcd05-7481-4e10-9600-98af46732afc service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:49.263739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-af6d48f7-eec0-4add-9eb3-51016807701c req-5a2dcd05-7481-4e10-9600-98af46732afc service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:49.264341 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-af6d48f7-eec0-4add-9eb3-51016807701c req-5a2dcd05-7481-4e10-9600-98af46732afc service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:49.284359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-af6d48f7-eec0-4add-9eb3-51016807701c req-5a2dcd05-7481-4e10-9600-98af46732afc service nova] Creating event network-vif-deleted:ebfc41b8-372f-4c67-97e3-7caa675975ac for instance ad92550c-f29b-4f97-9511-a2f1ffa98e3e on hv-cinder-84496 Aug 31 09:55:49.292890 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-af6d48f7-eec0-4add-9eb3-51016807701c req-5a2dcd05-7481-4e10-9600-98af46732afc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045702 Aug 31 09:55:49.298449 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 316/645] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:49.569214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-53f8c49a-4a19-4334-992e-3dbd767df497 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:49.570219 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-53f8c49a-4a19-4334-992e-3dbd767df497 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:49.574179 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:49.578376 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-53f8c49a-4a19-4334-992e-3dbd767df497 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:49.579021 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-53f8c49a-4a19-4334-992e-3dbd767df497 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:49.579515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-53f8c49a-4a19-4334-992e-3dbd767df497 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:49.580349 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-53f8c49a-4a19-4334-992e-3dbd767df497 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:49.580940 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-53f8c49a-4a19-4334-992e-3dbd767df497 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:49.581674 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-53f8c49a-4a19-4334-992e-3dbd767df497 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:49.623679 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-53f8c49a-4a19-4334-992e-3dbd767df497 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:49.624261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-53f8c49a-4a19-4334-992e-3dbd767df497 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:49.624784 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-53f8c49a-4a19-4334-992e-3dbd767df497 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:49.625281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.objects.instance [None req-53f8c49a-4a19-4334-992e-3dbd767df497 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lazy-loading 'fault' on Instance uuid ad92550c-f29b-4f97-9511-a2f1ffa98e3e {{(pid=127170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:55:49.679356 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-53f8c49a-4a19-4334-992e-3dbd767df497 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:49.690695 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-53f8c49a-4a19-4334-992e-3dbd767df497 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 200 len: 1334 microversion: 2.1 time: 0.125556 Aug 31 09:55:49.691282 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 330/646] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:49 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 1334 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:49.816456 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-98ee157e-3703-4fd2-8029-7e5f6a40bf22 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:49.817232 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-98ee157e-3703-4fd2-8029-7e5f6a40bf22 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:49.825000 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-98ee157e-3703-4fd2-8029-7e5f6a40bf22 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:49.825523 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-98ee157e-3703-4fd2-8029-7e5f6a40bf22 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:49.825963 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-98ee157e-3703-4fd2-8029-7e5f6a40bf22 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:49.826694 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-98ee157e-3703-4fd2-8029-7e5f6a40bf22 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:49.827155 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-98ee157e-3703-4fd2-8029-7e5f6a40bf22 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:49.827605 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-98ee157e-3703-4fd2-8029-7e5f6a40bf22 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:50.020425 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-98ee157e-3703-4fd2-8029-7e5f6a40bf22 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:50.043623 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-98ee157e-3703-4fd2-8029-7e5f6a40bf22 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3" status: 200 len: 1555 microversion: 2.1 time: 0.232924 Aug 31 09:55:50.044688 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 317/647] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:49 2022] GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3 => generated 1555 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:50.083768 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f359de41-865e-4506-828b-785a4f348d35 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:50.084676 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-f359de41-865e-4506-828b-785a4f348d35 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:50.095996 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f359de41-865e-4506-828b-785a4f348d35 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:50.097424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f359de41-865e-4506-828b-785a4f348d35 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:50.098221 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f359de41-865e-4506-828b-785a4f348d35 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:50.099491 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f359de41-865e-4506-828b-785a4f348d35 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:50.100592 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f359de41-865e-4506-828b-785a4f348d35 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:50.101369 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f359de41-865e-4506-828b-785a4f348d35 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:50.215038 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-f359de41-865e-4506-828b-785a4f348d35 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.138941 Aug 31 09:55:50.215821 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 331/648] 10.222.0.13 () {58 vars in 1275 bytes} [Wed Aug 31 09:55:50 2022] GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:50.713842 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-813e2b9b-052e-45d2-852c-c8a937b28f34 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:50.715615 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-813e2b9b-052e-45d2-852c-c8a937b28f34 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: ad92550c-f29b-4f97-9511-a2f1ffa98e3e] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:50.725201 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-813e2b9b-052e-45d2-852c-c8a937b28f34 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:50.725720 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-813e2b9b-052e-45d2-852c-c8a937b28f34 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:50.726367 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-813e2b9b-052e-45d2-852c-c8a937b28f34 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:50.727084 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-813e2b9b-052e-45d2-852c-c8a937b28f34 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:50.727597 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-813e2b9b-052e-45d2-852c-c8a937b28f34 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:50.728021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-813e2b9b-052e-45d2-852c-c8a937b28f34 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:50.745245 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.wsgi [None req-813e2b9b-052e-45d2-852c-c8a937b28f34 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] HTTP exception thrown: Instance ad92550c-f29b-4f97-9511-a2f1ffa98e3e could not be found. Aug 31 09:55:50.746856 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-813e2b9b-052e-45d2-852c-c8a937b28f34 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Request method failure captured: Aug 31 09:55:50.746856 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: request: GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e HTTP/1.1 Aug 31 09:55:50.746856 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept: application/json Aug 31 09:55:50.746856 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept-Encoding: identity Aug 31 09:55:50.746856 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Connection: close Aug 31 09:55:50.746856 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Length: 0 Aug 31 09:55:50.746856 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Type: application/json Aug 31 09:55:50.746856 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Host: 10.222.0.13 Aug 31 09:55:50.746856 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Openstack-System-Scope: None Aug 31 09:55:50.746856 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: User-Agent: python-urllib3/1.26.12 Aug 31 09:55:50.746856 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Auth-Token: gAAAAABjDy5OTDLNRfLh5I253GwLv23LsAUrNMn0r9xaten2h7_1_5xHwhGyUEaQYYHfDmmHCd0ZNSB8h1zSiuyFLSm9-AvFKxWjgyu8fdEQl6UJfoKqRgJfuqhoDcaQr_FT6z1TSznbTbqj78fmKsXLoDaJbKqpRSnNN2tpZX8CNlgCtAi_Hak Aug 31 09:55:50.746856 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Id: None Aug 31 09:55:50.746856 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Name: None Aug 31 09:55:50.746856 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Identity-Status: Confirmed Aug 31 09:55:50.746856 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Is-Admin-Project: True Aug 31 09:55:50.746856 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Id: default Aug 31 09:55:50.746856 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Name: Default Aug 31 09:55:50.746856 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Id: c0fc6660b5494415915cdf2b325e5bd6 Aug 31 09:55:50.746856 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-742304945 Aug 31 09:55:50.746856 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Role: member,reader Aug 31 09:55:50.746856 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Roles: member,reader Aug 31 09:55:50.748846 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c0fc6660b5494415915cdf2b325e5bd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c0fc6660b5494415915cdf2b325e5bd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c0fc6660b5494415915cdf2b325e5bd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c0fc6660b5494415915cdf2b325e5bd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:55:50.748846 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant: tempest-ServerRescueNegativeTestJSON-742304945 Aug 31 09:55:50.748846 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Id: c0fc6660b5494415915cdf2b325e5bd6 Aug 31 09:55:50.748846 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-742304945 Aug 31 09:55:50.748846 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User: tempest-ServerRescueNegativeTestJSON-742304945-project Aug 31 09:55:50.748846 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Id: default Aug 31 09:55:50.748846 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Name: Default Aug 31 09:55:50.748846 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Id: 886e40cf192d46c2b2e7eb2a95ec62e1 Aug 31 09:55:50.748846 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Name: tempest-ServerRescueNegativeTestJSON-742304945-project Aug 31 09:55:50.748846 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: method: > Aug 31 09:55:50.748846 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: exception: Instance ad92550c-f29b-4f97-9511-a2f1ffa98e3e could not be found. Aug 31 09:55:50.748846 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: action_args: {'id': 'ad92550c-f29b-4f97-9511-a2f1ffa98e3e'} Aug 31 09:55:50.750569 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:55:50.750569 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:50.750569 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:55:50.750569 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:55:50.750569 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:55:50.750569 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:55:50.750569 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:55:50.750569 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:55:50.750569 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:55:50.750569 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:55:50.750569 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad92550c-f29b-4f97-9511-a2f1ffa98e3e could not be found. Aug 31 09:55:50.750569 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:55:50.750569 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:50.750569 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:55:50.750569 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:50.750569 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:50.750569 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:50.750569 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:55:50.750569 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:55:50.750569 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:55:50.755970 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:55:50.755970 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:55:50.755970 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:55:50.755970 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:55:50.755970 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:55:50.755970 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:55:50.755970 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:55:50.755970 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad92550c-f29b-4f97-9511-a2f1ffa98e3e could not be found. Aug 31 09:55:50.755970 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:55:50.755970 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:50.755970 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:55:50.755970 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:50.755970 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:50.755970 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:50.755970 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:55:50.755970 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:55:50.755970 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad92550c-f29b-4f97-9511-a2f1ffa98e3e could not be found. Aug 31 09:55:50.755970 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:55:50.761100 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-813e2b9b-052e-45d2-852c-c8a937b28f34 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Returning 404 to user: Instance ad92550c-f29b-4f97-9511-a2f1ffa98e3e could not be found. {{(pid=127171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:55:50.761100 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-813e2b9b-052e-45d2-852c-c8a937b28f34 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e" status: 404 len: 111 microversion: 2.1 time: 0.039966 Aug 31 09:55:50.761668 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-1961458f-0fd0-4f86-b52b-30705e2ac6ce tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '.version_select at 0x7f5503dbc5e0>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:50.764905 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 318/649] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:50 2022] GET /compute/v2.1/servers/ad92550c-f29b-4f97-9511-a2f1ffa98e3e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:55:50.782321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-1961458f-0fd0-4f86-b52b-30705e2ac6ce tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-338542473" status: 202 len: 0 microversion: 2.1 time: 0.027773 Aug 31 09:55:50.787535 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 332/650] 10.222.0.13 () {58 vars in 1218 bytes} [Wed Aug 31 09:55:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-338542473 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:55:51.666988 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-07115340-0a4c-4a8c-bf16-b031bde73644 req-11752d04-0056-4186-b86a-8adcd1f4a163 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3238242-6707-4564-b749-b478f64967f3", "tag": "06438076-47dd-4bdb-a71f-1a49e57a577f"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:51.678707 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-07115340-0a4c-4a8c-bf16-b031bde73644 req-11752d04-0056-4186-b86a-8adcd1f4a163 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:51.679303 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-07115340-0a4c-4a8c-bf16-b031bde73644 req-11752d04-0056-4186-b86a-8adcd1f4a163 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:51.679824 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-07115340-0a4c-4a8c-bf16-b031bde73644 req-11752d04-0056-4186-b86a-8adcd1f4a163 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:51.692953 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-07115340-0a4c-4a8c-bf16-b031bde73644 req-11752d04-0056-4186-b86a-8adcd1f4a163 service nova] Creating event network-changed:06438076-47dd-4bdb-a71f-1a49e57a577f for instance a3238242-6707-4564-b749-b478f64967f3 on hv-cinder-84496 Aug 31 09:55:51.698937 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-07115340-0a4c-4a8c-bf16-b031bde73644 req-11752d04-0056-4186-b86a-8adcd1f4a163 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035886 Aug 31 09:55:51.699864 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 319/651] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:55:54.012287 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-3d087c65-dad0-4467-a8e3-2022aa4b9574 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:54.012844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-3d087c65-dad0-4467-a8e3-2022aa4b9574 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:54.020346 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3d087c65-dad0-4467-a8e3-2022aa4b9574 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:54.020827 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3d087c65-dad0-4467-a8e3-2022aa4b9574 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:54.021254 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3d087c65-dad0-4467-a8e3-2022aa4b9574 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:54.022096 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3d087c65-dad0-4467-a8e3-2022aa4b9574 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:54.022540 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3d087c65-dad0-4467-a8e3-2022aa4b9574 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:54.023068 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3d087c65-dad0-4467-a8e3-2022aa4b9574 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:54.053023 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-3d087c65-dad0-4467-a8e3-2022aa4b9574 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Going to try to terminate instance {{(pid=127170) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:55:54.138856 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-3d087c65-dad0-4467-a8e3-2022aa4b9574 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "DELETE /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 204 len: 0 microversion: 2.1 time: 0.130497 Aug 31 09:55:54.139480 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 333/652] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 09:55:54 2022] DELETE /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:55:54.149276 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-dc3cbf3e-fa97-4927-a391-d24f2223f774 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:54.150008 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-dc3cbf3e-fa97-4927-a391-d24f2223f774 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:54.156640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dc3cbf3e-fa97-4927-a391-d24f2223f774 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:54.157120 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dc3cbf3e-fa97-4927-a391-d24f2223f774 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:54.157586 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dc3cbf3e-fa97-4927-a391-d24f2223f774 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:54.158852 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dc3cbf3e-fa97-4927-a391-d24f2223f774 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:54.159299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dc3cbf3e-fa97-4927-a391-d24f2223f774 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:54.159715 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-dc3cbf3e-fa97-4927-a391-d24f2223f774 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:54.308746 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-dc3cbf3e-fa97-4927-a391-d24f2223f774 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:54.318098 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-dc3cbf3e-fa97-4927-a391-d24f2223f774 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1507 microversion: 2.1 time: 0.173471 Aug 31 09:55:54.318690 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 320/653] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:54 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:55.342479 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-8310c4b9-ee37-4f05-9568-e39c339d8f3f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:55.343748 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-8310c4b9-ee37-4f05-9568-e39c339d8f3f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:55.353703 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8310c4b9-ee37-4f05-9568-e39c339d8f3f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:55.354557 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8310c4b9-ee37-4f05-9568-e39c339d8f3f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:55.355294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8310c4b9-ee37-4f05-9568-e39c339d8f3f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:55.356190 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8310c4b9-ee37-4f05-9568-e39c339d8f3f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:55.356652 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8310c4b9-ee37-4f05-9568-e39c339d8f3f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:55.357074 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8310c4b9-ee37-4f05-9568-e39c339d8f3f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:55.604050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-8310c4b9-ee37-4f05-9568-e39c339d8f3f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:55.613482 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-8310c4b9-ee37-4f05-9568-e39c339d8f3f tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 200 len: 1507 microversion: 2.1 time: 0.276839 Aug 31 09:55:55.614099 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 334/654] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:55 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 1507 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:55.730798 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-1332e564-05bc-4932-9f39-d23dc31f41fa req-0aebd0c5-87ab-4b07-8889-c7bc4832a498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74c8f70a-11b4-47de-9677-637917aa5115", "name": "network-vif-deleted", "tag": "33cb2a1d-1582-4d9a-959c-ca576cea02dd"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:55.748315 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-1332e564-05bc-4932-9f39-d23dc31f41fa req-0aebd0c5-87ab-4b07-8889-c7bc4832a498 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:55.748803 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-1332e564-05bc-4932-9f39-d23dc31f41fa req-0aebd0c5-87ab-4b07-8889-c7bc4832a498 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:55.749498 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-1332e564-05bc-4932-9f39-d23dc31f41fa req-0aebd0c5-87ab-4b07-8889-c7bc4832a498 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:55.764706 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-1332e564-05bc-4932-9f39-d23dc31f41fa req-0aebd0c5-87ab-4b07-8889-c7bc4832a498 service nova] Creating event network-vif-deleted:33cb2a1d-1582-4d9a-959c-ca576cea02dd for instance 74c8f70a-11b4-47de-9677-637917aa5115 on hv-cinder-84496 Aug 31 09:55:55.771219 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-1332e564-05bc-4932-9f39-d23dc31f41fa req-0aebd0c5-87ab-4b07-8889-c7bc4832a498 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047710 Aug 31 09:55:55.771847 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 321/655] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:56.306728 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-dc42871c-c58c-49a6-87aa-4f03c47e92f8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:56.308993 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-dc42871c-c58c-49a6-87aa-4f03c47e92f8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:56.317735 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-dc42871c-c58c-49a6-87aa-4f03c47e92f8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:56.318912 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-dc42871c-c58c-49a6-87aa-4f03c47e92f8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:56.319479 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-dc42871c-c58c-49a6-87aa-4f03c47e92f8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:56.320394 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-dc42871c-c58c-49a6-87aa-4f03c47e92f8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:56.320893 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-dc42871c-c58c-49a6-87aa-4f03c47e92f8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:56.321333 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-dc42871c-c58c-49a6-87aa-4f03c47e92f8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:56.358924 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-dc42871c-c58c-49a6-87aa-4f03c47e92f8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056060 Aug 31 09:55:56.359665 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 335/656] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 31 09:55:56 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 09:55:56.429333 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-be26e5b8-fa31-4637-8c11-136790876a03 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:56.429965 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-be26e5b8-fa31-4637-8c11-136790876a03 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:56.436683 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be26e5b8-fa31-4637-8c11-136790876a03 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:56.437163 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be26e5b8-fa31-4637-8c11-136790876a03 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:56.437631 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be26e5b8-fa31-4637-8c11-136790876a03 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:56.438331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be26e5b8-fa31-4637-8c11-136790876a03 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:56.438777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be26e5b8-fa31-4637-8c11-136790876a03 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:56.439812 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be26e5b8-fa31-4637-8c11-136790876a03 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:56.468293 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-be26e5b8-fa31-4637-8c11-136790876a03 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Going to try to terminate instance {{(pid=127171) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:55:56.590592 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-be26e5b8-fa31-4637-8c11-136790876a03 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 204 len: 0 microversion: 2.1 time: 0.165251 Aug 31 09:55:56.591738 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 322/657] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 09:55:56 2022] DELETE /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:55:56.601689 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f658f6a9-d5f9-4086-8173-2d927b03e7ea tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:56.602345 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-f658f6a9-d5f9-4086-8173-2d927b03e7ea tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:56.609605 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f658f6a9-d5f9-4086-8173-2d927b03e7ea tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:56.610659 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f658f6a9-d5f9-4086-8173-2d927b03e7ea tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:56.612471 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f658f6a9-d5f9-4086-8173-2d927b03e7ea tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:56.613547 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f658f6a9-d5f9-4086-8173-2d927b03e7ea tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:56.615504 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f658f6a9-d5f9-4086-8173-2d927b03e7ea tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:56.615944 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f658f6a9-d5f9-4086-8173-2d927b03e7ea tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:56.642775 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-76ae8933-da59-46a2-a912-216664a3919a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:56.644228 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-76ae8933-da59-46a2-a912-216664a3919a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: 74c8f70a-11b4-47de-9677-637917aa5115] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:56.654773 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-76ae8933-da59-46a2-a912-216664a3919a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:56.656202 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-76ae8933-da59-46a2-a912-216664a3919a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:56.656431 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-76ae8933-da59-46a2-a912-216664a3919a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:56.658299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-76ae8933-da59-46a2-a912-216664a3919a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:56.659093 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-76ae8933-da59-46a2-a912-216664a3919a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:56.659914 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-76ae8933-da59-46a2-a912-216664a3919a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:56.681307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.wsgi [None req-76ae8933-da59-46a2-a912-216664a3919a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] HTTP exception thrown: Instance 74c8f70a-11b4-47de-9677-637917aa5115 could not be found. Aug 31 09:55:56.683103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-76ae8933-da59-46a2-a912-216664a3919a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Request method failure captured: Aug 31 09:55:56.683103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: request: GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 HTTP/1.1 Aug 31 09:55:56.683103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept: application/json Aug 31 09:55:56.683103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept-Encoding: identity Aug 31 09:55:56.683103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Connection: close Aug 31 09:55:56.683103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Length: 0 Aug 31 09:55:56.683103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Type: application/json Aug 31 09:55:56.683103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Host: 10.222.0.13 Aug 31 09:55:56.683103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Openstack-System-Scope: None Aug 31 09:55:56.683103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: User-Agent: python-urllib3/1.26.12 Aug 31 09:55:56.683103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Auth-Token: gAAAAABjDy5OTDLNRfLh5I253GwLv23LsAUrNMn0r9xaten2h7_1_5xHwhGyUEaQYYHfDmmHCd0ZNSB8h1zSiuyFLSm9-AvFKxWjgyu8fdEQl6UJfoKqRgJfuqhoDcaQr_FT6z1TSznbTbqj78fmKsXLoDaJbKqpRSnNN2tpZX8CNlgCtAi_Hak Aug 31 09:55:56.683103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Id: None Aug 31 09:55:56.683103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Name: None Aug 31 09:55:56.683103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Identity-Status: Confirmed Aug 31 09:55:56.683103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Is-Admin-Project: True Aug 31 09:55:56.683103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Id: default Aug 31 09:55:56.683103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Name: Default Aug 31 09:55:56.683103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Id: c0fc6660b5494415915cdf2b325e5bd6 Aug 31 09:55:56.683103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-742304945 Aug 31 09:55:56.683103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Role: member,reader Aug 31 09:55:56.683103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Roles: member,reader Aug 31 09:55:56.685664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c0fc6660b5494415915cdf2b325e5bd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c0fc6660b5494415915cdf2b325e5bd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c0fc6660b5494415915cdf2b325e5bd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c0fc6660b5494415915cdf2b325e5bd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:55:56.685664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant: tempest-ServerRescueNegativeTestJSON-742304945 Aug 31 09:55:56.685664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Id: c0fc6660b5494415915cdf2b325e5bd6 Aug 31 09:55:56.685664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-742304945 Aug 31 09:55:56.685664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User: tempest-ServerRescueNegativeTestJSON-742304945-project Aug 31 09:55:56.685664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Id: default Aug 31 09:55:56.685664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Name: Default Aug 31 09:55:56.685664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Id: 886e40cf192d46c2b2e7eb2a95ec62e1 Aug 31 09:55:56.685664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Name: tempest-ServerRescueNegativeTestJSON-742304945-project Aug 31 09:55:56.685664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: method: > Aug 31 09:55:56.685664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: exception: Instance 74c8f70a-11b4-47de-9677-637917aa5115 could not be found. Aug 31 09:55:56.685664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: action_args: {'id': '74c8f70a-11b4-47de-9677-637917aa5115'} Aug 31 09:55:56.686831 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:55:56.686831 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:56.686831 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:55:56.686831 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:55:56.686831 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:55:56.686831 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:55:56.686831 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:55:56.686831 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:55:56.686831 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:55:56.686831 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:55:56.686831 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74c8f70a-11b4-47de-9677-637917aa5115 could not be found. Aug 31 09:55:56.686831 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:55:56.686831 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:56.686831 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:55:56.686831 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:56.686831 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:56.686831 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:56.686831 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:55:56.686831 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:55:56.686831 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:55:56.688359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:55:56.688359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:55:56.688359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:55:56.688359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:55:56.688359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:55:56.688359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:55:56.688359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:55:56.688359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74c8f70a-11b4-47de-9677-637917aa5115 could not be found. Aug 31 09:55:56.688359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:55:56.688359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:56.688359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:55:56.688359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:56.688359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:56.688359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:56.688359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:55:56.688359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:55:56.688359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74c8f70a-11b4-47de-9677-637917aa5115 could not be found. Aug 31 09:55:56.688359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:55:56.689681 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-76ae8933-da59-46a2-a912-216664a3919a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Returning 404 to user: Instance 74c8f70a-11b4-47de-9677-637917aa5115 could not be found. {{(pid=127171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:55:56.689681 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-76ae8933-da59-46a2-a912-216664a3919a tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115" status: 404 len: 111 microversion: 2.1 time: 0.051578 Aug 31 09:55:56.689681 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 323/658] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:56 2022] GET /compute/v2.1/servers/74c8f70a-11b4-47de-9677-637917aa5115 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:55:56.693525 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-b72be602-61d5-4138-8fa3-c817918e3eec tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:56.694025 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-b72be602-61d5-4138-8fa3-c817918e3eec tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:56.700887 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b72be602-61d5-4138-8fa3-c817918e3eec tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:56.701373 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b72be602-61d5-4138-8fa3-c817918e3eec tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:56.701837 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b72be602-61d5-4138-8fa3-c817918e3eec tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:56.702560 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b72be602-61d5-4138-8fa3-c817918e3eec tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:56.703002 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b72be602-61d5-4138-8fa3-c817918e3eec tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:56.703435 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b72be602-61d5-4138-8fa3-c817918e3eec tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:56.732488 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-b72be602-61d5-4138-8fa3-c817918e3eec tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Going to try to terminate instance {{(pid=127171) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:55:56.790674 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-f658f6a9-d5f9-4086-8173-2d927b03e7ea tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:56.806657 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-f658f6a9-d5f9-4086-8173-2d927b03e7ea tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1674 microversion: 2.1 time: 0.209151 Aug 31 09:55:56.807982 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 336/659] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:56 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1674 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:56.833003 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-b72be602-61d5-4138-8fa3-c817918e3eec tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 204 len: 0 microversion: 2.1 time: 0.143224 Aug 31 09:55:56.833664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 324/660] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 09:55:56 2022] DELETE /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 09:55:56.841825 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-4d8a5ed2-21de-47e8-a1d1-d1bf0fc19551 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:56.842441 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-4d8a5ed2-21de-47e8-a1d1-d1bf0fc19551 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:56.849727 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4d8a5ed2-21de-47e8-a1d1-d1bf0fc19551 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:56.850220 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4d8a5ed2-21de-47e8-a1d1-d1bf0fc19551 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:56.850649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4d8a5ed2-21de-47e8-a1d1-d1bf0fc19551 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:56.851428 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4d8a5ed2-21de-47e8-a1d1-d1bf0fc19551 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:56.851990 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4d8a5ed2-21de-47e8-a1d1-d1bf0fc19551 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:56.852413 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4d8a5ed2-21de-47e8-a1d1-d1bf0fc19551 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:56.995761 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-4d8a5ed2-21de-47e8-a1d1-d1bf0fc19551 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:57.004969 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-4d8a5ed2-21de-47e8-a1d1-d1bf0fc19551 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.166952 Aug 31 09:55:57.005587 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 337/661] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:56 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:57.831904 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-a84ecc86-0501-4694-8c6d-093b72e47a42 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:57.832774 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-a84ecc86-0501-4694-8c6d-093b72e47a42 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:57.839710 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a84ecc86-0501-4694-8c6d-093b72e47a42 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:57.840207 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a84ecc86-0501-4694-8c6d-093b72e47a42 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:57.840649 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a84ecc86-0501-4694-8c6d-093b72e47a42 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:57.841368 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a84ecc86-0501-4694-8c6d-093b72e47a42 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:57.841850 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a84ecc86-0501-4694-8c6d-093b72e47a42 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:57.842410 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a84ecc86-0501-4694-8c6d-093b72e47a42 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:57.993792 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-a84ecc86-0501-4694-8c6d-093b72e47a42 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:58.003956 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-a84ecc86-0501-4694-8c6d-093b72e47a42 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1674 microversion: 2.1 time: 0.177180 Aug 31 09:55:58.004544 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 325/662] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:57 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1674 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:58.028768 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-69692032-7124-4a09-859e-bb0b18f35c9d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:58.030106 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-69692032-7124-4a09-859e-bb0b18f35c9d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:58.039378 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-69692032-7124-4a09-859e-bb0b18f35c9d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:58.040022 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-69692032-7124-4a09-859e-bb0b18f35c9d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:58.040696 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-69692032-7124-4a09-859e-bb0b18f35c9d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:58.041981 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-69692032-7124-4a09-859e-bb0b18f35c9d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:58.042593 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-69692032-7124-4a09-859e-bb0b18f35c9d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:58.043058 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-69692032-7124-4a09-859e-bb0b18f35c9d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:58.269081 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-69692032-7124-4a09-859e-bb0b18f35c9d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:58.277442 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-69692032-7124-4a09-859e-bb0b18f35c9d tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1523 microversion: 2.1 time: 0.254372 Aug 31 09:55:58.278045 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 338/663] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:58 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1523 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:55:58.980183 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-1a7ac62b-9ef9-4478-bc6a-e6270f2886fa req-05983d65-901e-4b60-b3bf-08df7e4335b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd0a166f-d662-4a72-8ea2-bfbbb02b2221", "name": "network-vif-deleted", "tag": "dc0a1702-552b-409c-91a1-5a380acf6fea"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:59.002565 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-1a7ac62b-9ef9-4478-bc6a-e6270f2886fa req-05983d65-901e-4b60-b3bf-08df7e4335b9 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:59.003624 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-1a7ac62b-9ef9-4478-bc6a-e6270f2886fa req-05983d65-901e-4b60-b3bf-08df7e4335b9 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:59.004529 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-1a7ac62b-9ef9-4478-bc6a-e6270f2886fa req-05983d65-901e-4b60-b3bf-08df7e4335b9 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:59.032170 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-1a7ac62b-9ef9-4478-bc6a-e6270f2886fa req-05983d65-901e-4b60-b3bf-08df7e4335b9 service nova] Creating event network-vif-deleted:dc0a1702-552b-409c-91a1-5a380acf6fea for instance dd0a166f-d662-4a72-8ea2-bfbbb02b2221 on hv-cinder-84496 Aug 31 09:55:59.039997 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-2855fa8c-fccc-4fa1-a3a9-0d9afd2ceebd tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:59.040790 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-2855fa8c-fccc-4fa1-a3a9-0d9afd2ceebd tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:59.059575 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-1a7ac62b-9ef9-4478-bc6a-e6270f2886fa req-05983d65-901e-4b60-b3bf-08df7e4335b9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096363 Aug 31 09:55:59.060297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2855fa8c-fccc-4fa1-a3a9-0d9afd2ceebd tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:59.061328 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2855fa8c-fccc-4fa1-a3a9-0d9afd2ceebd tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:59.061907 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 326/664] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:59.062171 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2855fa8c-fccc-4fa1-a3a9-0d9afd2ceebd tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:59.064723 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2855fa8c-fccc-4fa1-a3a9-0d9afd2ceebd tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:59.065238 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2855fa8c-fccc-4fa1-a3a9-0d9afd2ceebd tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:59.065592 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2855fa8c-fccc-4fa1-a3a9-0d9afd2ceebd tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:59.109589 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:59.305602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-28e2d2ce-ca8e-4158-9c0f-db95d927317e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:59.307037 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-28e2d2ce-ca8e-4158-9c0f-db95d927317e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:59.320997 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-28e2d2ce-ca8e-4158-9c0f-db95d927317e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:59.322295 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-28e2d2ce-ca8e-4158-9c0f-db95d927317e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:59.323745 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-28e2d2ce-ca8e-4158-9c0f-db95d927317e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:59.325165 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-28e2d2ce-ca8e-4158-9c0f-db95d927317e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:59.326353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-28e2d2ce-ca8e-4158-9c0f-db95d927317e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:59.327432 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-28e2d2ce-ca8e-4158-9c0f-db95d927317e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:59.384206 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:59.408586 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-28e2d2ce-ca8e-4158-9c0f-db95d927317e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:59.409480 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-28e2d2ce-ca8e-4158-9c0f-db95d927317e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:59.410133 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-28e2d2ce-ca8e-4158-9c0f-db95d927317e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:59.410796 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.objects.instance [None req-28e2d2ce-ca8e-4158-9c0f-db95d927317e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lazy-loading 'fault' on Instance uuid dd0a166f-d662-4a72-8ea2-bfbbb02b2221 {{(pid=127171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:55:59.503355 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-2855fa8c-fccc-4fa1-a3a9-0d9afd2ceebd tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:59.507885 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-28e2d2ce-ca8e-4158-9c0f-db95d927317e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886e40cf192d46c2b2e7eb2a95ec62e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc6660b5494415915cdf2b325e5bd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:59.520951 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-28e2d2ce-ca8e-4158-9c0f-db95d927317e tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 200 len: 1312 microversion: 2.1 time: 0.223812 Aug 31 09:55:59.521820 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 327/665] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:59 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 1312 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:59.533627 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-2855fa8c-fccc-4fa1-a3a9-0d9afd2ceebd tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1606 microversion: 2.1 time: 0.489355 Aug 31 09:55:59.533627 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 339/666] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:59 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1606 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:59.780077 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-6d829d42-220f-4329-a004-9b1ef299628d req-01d57139-6d77-4f5b-a3ac-25adee6b3f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e598a8ab-5332-4c3c-8f72-098d0ac6a3c8", "name": "network-vif-deleted", "tag": "cae2bef1-d3f5-4bd0-b345-99fbc7e354b9"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:59.791490 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-6d829d42-220f-4329-a004-9b1ef299628d req-01d57139-6d77-4f5b-a3ac-25adee6b3f70 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:59.791925 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-6d829d42-220f-4329-a004-9b1ef299628d req-01d57139-6d77-4f5b-a3ac-25adee6b3f70 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:59.792541 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-6d829d42-220f-4329-a004-9b1ef299628d req-01d57139-6d77-4f5b-a3ac-25adee6b3f70 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:59.809425 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-6d829d42-220f-4329-a004-9b1ef299628d req-01d57139-6d77-4f5b-a3ac-25adee6b3f70 service nova] Creating event network-vif-deleted:cae2bef1-d3f5-4bd0-b345-99fbc7e354b9 for instance e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 on hv-cinder-84496 Aug 31 09:55:59.814814 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-6d829d42-220f-4329-a004-9b1ef299628d req-01d57139-6d77-4f5b-a3ac-25adee6b3f70 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038603 Aug 31 09:55:59.815418 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 340/667] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:56:00.553482 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-ab0603fb-f827-466b-bb52-648b2a74f416 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:00.554203 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-ab0603fb-f827-466b-bb52-648b2a74f416 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] [instance: dd0a166f-d662-4a72-8ea2-bfbbb02b2221] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:00.555506 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-2e3ea5dc-f619-42e2-b2c6-e185c8f411b2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:00.556238 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-2e3ea5dc-f619-42e2-b2c6-e185c8f411b2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:00.569920 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ab0603fb-f827-466b-bb52-648b2a74f416 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:00.571369 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ab0603fb-f827-466b-bb52-648b2a74f416 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:00.572068 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2e3ea5dc-f619-42e2-b2c6-e185c8f411b2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:00.572581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2e3ea5dc-f619-42e2-b2c6-e185c8f411b2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:00.573017 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2e3ea5dc-f619-42e2-b2c6-e185c8f411b2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:00.573661 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ab0603fb-f827-466b-bb52-648b2a74f416 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:00.574384 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ab0603fb-f827-466b-bb52-648b2a74f416 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:00.574837 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ab0603fb-f827-466b-bb52-648b2a74f416 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:00.575298 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ab0603fb-f827-466b-bb52-648b2a74f416 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:00.576132 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2e3ea5dc-f619-42e2-b2c6-e185c8f411b2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:00.576727 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2e3ea5dc-f619-42e2-b2c6-e185c8f411b2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:00.577069 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2e3ea5dc-f619-42e2-b2c6-e185c8f411b2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:00.598203 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.wsgi [None req-ab0603fb-f827-466b-bb52-648b2a74f416 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] HTTP exception thrown: Instance dd0a166f-d662-4a72-8ea2-bfbbb02b2221 could not be found. Aug 31 09:56:00.600014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-ab0603fb-f827-466b-bb52-648b2a74f416 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Request method failure captured: Aug 31 09:56:00.600014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: request: GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 HTTP/1.1 Aug 31 09:56:00.600014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept: application/json Aug 31 09:56:00.600014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept-Encoding: identity Aug 31 09:56:00.600014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Connection: close Aug 31 09:56:00.600014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Length: 0 Aug 31 09:56:00.600014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Type: application/json Aug 31 09:56:00.600014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Host: 10.222.0.13 Aug 31 09:56:00.600014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Openstack-System-Scope: None Aug 31 09:56:00.600014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: User-Agent: python-urllib3/1.26.12 Aug 31 09:56:00.600014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Auth-Token: gAAAAABjDy5OTDLNRfLh5I253GwLv23LsAUrNMn0r9xaten2h7_1_5xHwhGyUEaQYYHfDmmHCd0ZNSB8h1zSiuyFLSm9-AvFKxWjgyu8fdEQl6UJfoKqRgJfuqhoDcaQr_FT6z1TSznbTbqj78fmKsXLoDaJbKqpRSnNN2tpZX8CNlgCtAi_Hak Aug 31 09:56:00.600014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Id: None Aug 31 09:56:00.600014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Name: None Aug 31 09:56:00.600014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Identity-Status: Confirmed Aug 31 09:56:00.600014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Is-Admin-Project: True Aug 31 09:56:00.600014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Id: default Aug 31 09:56:00.600014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Name: Default Aug 31 09:56:00.600014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Id: c0fc6660b5494415915cdf2b325e5bd6 Aug 31 09:56:00.600014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-742304945 Aug 31 09:56:00.600014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Role: member,reader Aug 31 09:56:00.600014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Roles: member,reader Aug 31 09:56:00.601607 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c0fc6660b5494415915cdf2b325e5bd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c0fc6660b5494415915cdf2b325e5bd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c0fc6660b5494415915cdf2b325e5bd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c0fc6660b5494415915cdf2b325e5bd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:56:00.601607 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant: tempest-ServerRescueNegativeTestJSON-742304945 Aug 31 09:56:00.601607 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Id: c0fc6660b5494415915cdf2b325e5bd6 Aug 31 09:56:00.601607 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-742304945 Aug 31 09:56:00.601607 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User: tempest-ServerRescueNegativeTestJSON-742304945-project Aug 31 09:56:00.601607 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Id: default Aug 31 09:56:00.601607 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Name: Default Aug 31 09:56:00.601607 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Id: 886e40cf192d46c2b2e7eb2a95ec62e1 Aug 31 09:56:00.601607 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Name: tempest-ServerRescueNegativeTestJSON-742304945-project Aug 31 09:56:00.601607 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: method: > Aug 31 09:56:00.601607 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: exception: Instance dd0a166f-d662-4a72-8ea2-bfbbb02b2221 could not be found. Aug 31 09:56:00.601607 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: action_args: {'id': 'dd0a166f-d662-4a72-8ea2-bfbbb02b2221'} Aug 31 09:56:00.602398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:56:00.602398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:00.602398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:56:00.602398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:56:00.602398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:56:00.602398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:56:00.602398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:56:00.602398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:56:00.602398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:56:00.602398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:56:00.602398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd0a166f-d662-4a72-8ea2-bfbbb02b2221 could not be found. Aug 31 09:56:00.602398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:56:00.602398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:00.602398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:56:00.602398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:00.602398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:00.602398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:00.602398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:56:00.602398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:56:00.602398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:56:00.603593 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:56:00.603593 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:56:00.603593 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:56:00.603593 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:56:00.603593 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:56:00.603593 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:56:00.603593 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:56:00.603593 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd0a166f-d662-4a72-8ea2-bfbbb02b2221 could not be found. Aug 31 09:56:00.603593 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:56:00.603593 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:00.603593 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:56:00.603593 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:00.603593 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:00.603593 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:00.603593 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:56:00.603593 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:56:00.603593 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd0a166f-d662-4a72-8ea2-bfbbb02b2221 could not be found. Aug 31 09:56:00.603593 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:56:00.604659 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-ab0603fb-f827-466b-bb52-648b2a74f416 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] Returning 404 to user: Instance dd0a166f-d662-4a72-8ea2-bfbbb02b2221 could not be found. {{(pid=127171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:56:00.604659 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-ab0603fb-f827-466b-bb52-648b2a74f416 tempest-ServerRescueNegativeTestJSON-742304945 tempest-ServerRescueNegativeTestJSON-742304945-project] 10.222.0.13 "GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221" status: 404 len: 111 microversion: 2.1 time: 0.059925 Aug 31 09:56:00.604659 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 328/668] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:00 2022] GET /compute/v2.1/servers/dd0a166f-d662-4a72-8ea2-bfbbb02b2221 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:56:00.621862 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2e3ea5dc-f619-42e2-b2c6-e185c8f411b2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:00.622407 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2e3ea5dc-f619-42e2-b2c6-e185c8f411b2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:00.622844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2e3ea5dc-f619-42e2-b2c6-e185c8f411b2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:00.623287 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.objects.instance [None req-2e3ea5dc-f619-42e2-b2c6-e185c8f411b2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lazy-loading 'fault' on Instance uuid e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 {{(pid=127170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:56:00.669731 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-2e3ea5dc-f619-42e2-b2c6-e185c8f411b2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:00.678223 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-2e3ea5dc-f619-42e2-b2c6-e185c8f411b2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 200 len: 1327 microversion: 2.1 time: 0.130843 Aug 31 09:56:00.681531 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 341/669] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:00 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 1327 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:01.700182 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-278e3a7d-f95a-4e64-b426-7b463357f562 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:01.700810 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-278e3a7d-f95a-4e64-b426-7b463357f562 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:01.710922 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-278e3a7d-f95a-4e64-b426-7b463357f562 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:01.711541 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-278e3a7d-f95a-4e64-b426-7b463357f562 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:01.711994 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-278e3a7d-f95a-4e64-b426-7b463357f562 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:01.713029 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-278e3a7d-f95a-4e64-b426-7b463357f562 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:01.713528 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-278e3a7d-f95a-4e64-b426-7b463357f562 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:01.714034 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-278e3a7d-f95a-4e64-b426-7b463357f562 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:01.729751 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.wsgi [None req-278e3a7d-f95a-4e64-b426-7b463357f562 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] HTTP exception thrown: Instance e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 could not be found. Aug 31 09:56:01.731306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-278e3a7d-f95a-4e64-b426-7b463357f562 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Request method failure captured: Aug 31 09:56:01.731306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: request: GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 HTTP/1.1 Aug 31 09:56:01.731306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept: application/json Aug 31 09:56:01.731306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept-Encoding: identity Aug 31 09:56:01.731306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Connection: close Aug 31 09:56:01.731306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Length: 0 Aug 31 09:56:01.731306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Type: application/json Aug 31 09:56:01.731306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Host: 10.222.0.13 Aug 31 09:56:01.731306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Openstack-System-Scope: None Aug 31 09:56:01.731306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: User-Agent: python-urllib3/1.26.12 Aug 31 09:56:01.731306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Auth-Token: gAAAAABjDy5See43u58u5EXG3loy4AhYMwy6YaTNJnReW9dKOgGiQKvfsTky41o7p2qc1PKgqh5R7FYZXO249sKPlNGgdXV3ksIpIJWoTxRv5osyE8ZAH_nq2Zvv0ydkq9Xy9kz5N6-QlrDPIwOFePyKBNTXxobLBAq5hsin8Q-HeKlXK1OF9yA Aug 31 09:56:01.731306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Id: None Aug 31 09:56:01.731306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Name: None Aug 31 09:56:01.731306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Identity-Status: Confirmed Aug 31 09:56:01.731306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Is-Admin-Project: True Aug 31 09:56:01.731306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Id: default Aug 31 09:56:01.731306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Name: Default Aug 31 09:56:01.731306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Id: 05be916a558445ee8550559d491efbd0 Aug 31 09:56:01.731306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Name: tempest-AttachVolumeTestJSON-1716048162 Aug 31 09:56:01.731306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Role: member,reader Aug 31 09:56:01.731306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Roles: member,reader Aug 31 09:56:01.732829 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/05be916a558445ee8550559d491efbd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/05be916a558445ee8550559d491efbd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/05be916a558445ee8550559d491efbd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_05be916a558445ee8550559d491efbd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:56:01.732829 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant: tempest-AttachVolumeTestJSON-1716048162 Aug 31 09:56:01.732829 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Id: 05be916a558445ee8550559d491efbd0 Aug 31 09:56:01.732829 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1716048162 Aug 31 09:56:01.732829 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User: tempest-AttachVolumeTestJSON-1716048162-project Aug 31 09:56:01.732829 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Id: default Aug 31 09:56:01.732829 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Name: Default Aug 31 09:56:01.732829 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Id: 4961545b43f74fdb87d01b78600d54ed Aug 31 09:56:01.732829 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Name: tempest-AttachVolumeTestJSON-1716048162-project Aug 31 09:56:01.732829 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: method: > Aug 31 09:56:01.732829 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: exception: Instance e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 could not be found. Aug 31 09:56:01.732829 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: action_args: {'id': 'e598a8ab-5332-4c3c-8f72-098d0ac6a3c8'} Aug 31 09:56:01.733811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:56:01.733811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:01.733811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:56:01.733811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:56:01.733811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:56:01.733811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:56:01.733811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:56:01.733811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:56:01.733811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:56:01.733811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:56:01.733811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 could not be found. Aug 31 09:56:01.733811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:56:01.733811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:01.733811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:56:01.733811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:01.733811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:01.733811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:01.733811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:56:01.733811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:56:01.733811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:56:01.735317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:56:01.735317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:56:01.735317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:56:01.735317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:56:01.735317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:56:01.735317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:56:01.735317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:56:01.735317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 could not be found. Aug 31 09:56:01.735317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:56:01.735317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:01.735317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:56:01.735317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:01.735317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:01.735317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:01.735317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:56:01.735317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:56:01.735317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 could not be found. Aug 31 09:56:01.735317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:56:01.736694 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-278e3a7d-f95a-4e64-b426-7b463357f562 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Returning 404 to user: Instance e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 could not be found. {{(pid=127171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:56:01.736694 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-278e3a7d-f95a-4e64-b426-7b463357f562 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 404 len: 111 microversion: 2.1 time: 0.036408 Aug 31 09:56:01.737539 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 329/670] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:01 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 09:56:01.743265 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-6b325ac0-13d6-4aec-8678-bf8dec77bc45 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '.version_select at 0x7f5503dcc0d0>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:01.765134 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-6b325ac0-13d6-4aec-8678-bf8dec77bc45 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-702003126" status: 202 len: 0 microversion: 2.1 time: 0.026534 Aug 31 09:56:01.765984 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 342/671] 10.222.0.13 () {58 vars in 1218 bytes} [Wed Aug 31 09:56:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-702003126 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 09:56:03.133420 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-f8b7c28a-bf97-459a-a224-15684d1b036f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:03.134175 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-f8b7c28a-bf97-459a-a224-15684d1b036f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:03.140997 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f8b7c28a-bf97-459a-a224-15684d1b036f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:03.141530 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f8b7c28a-bf97-459a-a224-15684d1b036f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:03.142669 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f8b7c28a-bf97-459a-a224-15684d1b036f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:03.143387 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f8b7c28a-bf97-459a-a224-15684d1b036f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:03.143839 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f8b7c28a-bf97-459a-a224-15684d1b036f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:03.144296 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f8b7c28a-bf97-459a-a224-15684d1b036f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:03.169887 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.objects.instance [None req-f8b7c28a-bf97-459a-a224-15684d1b036f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lazy-loading 'flavor' on Instance uuid 1b32c74c-ed7a-496f-bf84-ce2d50e8b808 {{(pid=127171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:56:03.215509 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-75267d82-e85a-4fb5-9b4e-95ad03b8caa9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Action: 'create', calling method: .version_select at 0x7f5503dad550>, body: {"keypair": {"name": "tempest-keypair-262318595", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCs57I7WSxSNRXvzjS0nNGgidEhcE20BSf0j8yUrriFaj6KobfKmUKoEVNqO+vbZ6sw4VsB/ZV2tJrqaVNFC1YuNMAypQ6bmu6TLRjdBVAISwDeqpDXPFkiB1Kvu6PTiIQ=="}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:03.242975 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-75267d82-e85a-4fb5-9b4e-95ad03b8caa9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Getting quotas for project 05be916a558445ee8550559d491efbd0. Resources: {'key_pairs'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:56:03.248727 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-75267d82-e85a-4fb5-9b4e-95ad03b8caa9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Getting quotas for user 4961545b43f74fdb87d01b78600d54ed and project 05be916a558445ee8550559d491efbd0. Resources: {'key_pairs'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:56:03.278465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-75267d82-e85a-4fb5-9b4e-95ad03b8caa9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.066910 Aug 31 09:56:03.284917 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 343/672] 10.222.0.13 () {60 vars in 1159 bytes} [Wed Aug 31 09:56:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:56:03.285496 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-f8b7c28a-bf97-459a-a224-15684d1b036f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "POST /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808/action" status: 202 len: 0 microversion: 2.1 time: 0.155685 Aug 31 09:56:03.286238 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 330/673] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 31 09:56:03 2022] POST /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:56:03.308434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f7eaeb44-9b33-4c38-bb73-2552f05e2349 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:03.309253 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-f7eaeb44-9b33-4c38-bb73-2552f05e2349 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:03.323355 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f7eaeb44-9b33-4c38-bb73-2552f05e2349 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:03.324203 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f7eaeb44-9b33-4c38-bb73-2552f05e2349 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:03.324324 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f7eaeb44-9b33-4c38-bb73-2552f05e2349 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:03.325010 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f7eaeb44-9b33-4c38-bb73-2552f05e2349 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:03.328910 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f7eaeb44-9b33-4c38-bb73-2552f05e2349 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:03.330311 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f7eaeb44-9b33-4c38-bb73-2552f05e2349 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:03.585096 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-f7eaeb44-9b33-4c38-bb73-2552f05e2349 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:03.594116 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-f7eaeb44-9b33-4c38-bb73-2552f05e2349 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1566 microversion: 2.1 time: 0.293673 Aug 31 09:56:03.596113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 344/674] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:03 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1566 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:04.620875 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-aac63f9e-e174-4b8f-b700-79bb4f1a58ea tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:04.622305 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-aac63f9e-e174-4b8f-b700-79bb4f1a58ea tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:04.635983 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-aac63f9e-e174-4b8f-b700-79bb4f1a58ea tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:04.636489 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-aac63f9e-e174-4b8f-b700-79bb4f1a58ea tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:04.636931 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-aac63f9e-e174-4b8f-b700-79bb4f1a58ea tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:04.637723 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-aac63f9e-e174-4b8f-b700-79bb4f1a58ea tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:04.638178 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-aac63f9e-e174-4b8f-b700-79bb4f1a58ea tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:04.638602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-aac63f9e-e174-4b8f-b700-79bb4f1a58ea tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:04.857969 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-aac63f9e-e174-4b8f-b700-79bb4f1a58ea tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:04.869860 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-aac63f9e-e174-4b8f-b700-79bb4f1a58ea tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1566 microversion: 2.1 time: 0.253983 Aug 31 09:56:04.879044 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 331/675] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:04 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1566 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:05.513130 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-9a6fbe10-d46c-4043-9e7c-e7171def765d tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-885571128", "imageRef": "8e078bb9-f274-4984-8128-d31407d49604", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36c1318a-9832-4bc9-ac1a-5f597bd8ac6c"}], "security_groups": [{"name": "tempest-securitygroup--1366912082"}], "key_name": "tempest-keypair-262318595", "user_data": "}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:05.638869 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.network.neutron [None req-9a6fbe10-d46c-4043-9e7c-e7171def765d tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] validate_networks() for [('36c1318a-9832-4bc9-ac1a-5f597bd8ac6c', None, None, None, None, None)] {{(pid=127170) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:56:05.891433 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-4d6ad7cc-e875-4de7-bc9f-2780fb537e16 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:05.893154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-4d6ad7cc-e875-4de7-bc9f-2780fb537e16 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:05.899647 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4d6ad7cc-e875-4de7-bc9f-2780fb537e16 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:05.900135 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4d6ad7cc-e875-4de7-bc9f-2780fb537e16 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:05.900563 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4d6ad7cc-e875-4de7-bc9f-2780fb537e16 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:05.901259 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4d6ad7cc-e875-4de7-bc9f-2780fb537e16 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:05.901730 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4d6ad7cc-e875-4de7-bc9f-2780fb537e16 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:05.902142 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4d6ad7cc-e875-4de7-bc9f-2780fb537e16 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:06.120098 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-9a6fbe10-d46c-4043-9e7c-e7171def765d tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Flavor limits 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:56:06.120768 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-9a6fbe10-d46c-4043-9e7c-e7171def765d tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Image limits 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:56:06.121491 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-9a6fbe10-d46c-4043-9e7c-e7171def765d tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Flavor pref 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:56:06.122046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-9a6fbe10-d46c-4043-9e7c-e7171def765d tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Image pref 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:56:06.122468 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-9a6fbe10-d46c-4043-9e7c-e7171def765d tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:56:06.132994 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9a6fbe10-d46c-4043-9e7c-e7171def765d tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:06.133508 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9a6fbe10-d46c-4043-9e7c-e7171def765d tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:06.133651 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-4d6ad7cc-e875-4de7-bc9f-2780fb537e16 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:06.133942 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9a6fbe10-d46c-4043-9e7c-e7171def765d tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:06.134665 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9a6fbe10-d46c-4043-9e7c-e7171def765d tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:06.135115 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9a6fbe10-d46c-4043-9e7c-e7171def765d tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:06.135700 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9a6fbe10-d46c-4043-9e7c-e7171def765d tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:06.141764 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-4d6ad7cc-e875-4de7-bc9f-2780fb537e16 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1566 microversion: 2.1 time: 0.254263 Aug 31 09:56:06.143976 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 332/676] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:05 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1566 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:06.160069 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-9a6fbe10-d46c-4043-9e7c-e7171def765d tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Getting quotas for project 05be916a558445ee8550559d491efbd0. Resources: {'ram', 'instances', 'cores'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:56:06.164386 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-9a6fbe10-d46c-4043-9e7c-e7171def765d tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Getting quotas for user 4961545b43f74fdb87d01b78600d54ed and project 05be916a558445ee8550559d491efbd0. Resources: {'ram', 'instances', 'cores'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:56:06.176856 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-9a6fbe10-d46c-4043-9e7c-e7171def765d tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Going to run 1 instances... {{(pid=127170) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:56:06.179184 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-9a6fbe10-d46c-4043-9e7c-e7171def765d tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8e078bb9-f274-4984-8128-d31407d49604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:56:06.227376 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-9a6fbe10-d46c-4043-9e7c-e7171def765d tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.718535 Aug 31 09:56:06.228282 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 345/677] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 31 09:56:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:56:06.239487 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-7f9f8069-ce60-453a-8aa3-58aef9507ca2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:06.240100 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-7f9f8069-ce60-453a-8aa3-58aef9507ca2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:06.299521 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7f9f8069-ce60-453a-8aa3-58aef9507ca2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:06.306795 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-7f9f8069-ce60-453a-8aa3-58aef9507ca2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 200 len: 1236 microversion: 2.1 time: 0.071663 Aug 31 09:56:06.307368 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 333/678] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:06 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 1236 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:07.165967 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-7f5c2c57-a6d4-4c83-a644-ccdb5ab93bdf tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:07.166580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-7f5c2c57-a6d4-4c83-a644-ccdb5ab93bdf tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:07.174257 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7f5c2c57-a6d4-4c83-a644-ccdb5ab93bdf tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:07.174743 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7f5c2c57-a6d4-4c83-a644-ccdb5ab93bdf tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:07.175159 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7f5c2c57-a6d4-4c83-a644-ccdb5ab93bdf tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:07.175845 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7f5c2c57-a6d4-4c83-a644-ccdb5ab93bdf tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:07.176394 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7f5c2c57-a6d4-4c83-a644-ccdb5ab93bdf tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:07.176703 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7f5c2c57-a6d4-4c83-a644-ccdb5ab93bdf tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:07.334155 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-a1d3d4e3-35a2-4a63-bd5d-3755c9d80b11 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:07.336188 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-a1d3d4e3-35a2-4a63-bd5d-3755c9d80b11 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:07.368666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-7f5c2c57-a6d4-4c83-a644-ccdb5ab93bdf tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:07.388784 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-7f5c2c57-a6d4-4c83-a644-ccdb5ab93bdf tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1566 microversion: 2.1 time: 0.227440 Aug 31 09:56:07.390517 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 346/679] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:07 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1566 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:07.433800 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-a1d3d4e3-35a2-4a63-bd5d-3755c9d80b11 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:07.442923 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-a1d3d4e3-35a2-4a63-bd5d-3755c9d80b11 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 200 len: 1236 microversion: 2.1 time: 0.118641 Aug 31 09:56:07.443597 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 334/680] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:07 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 1236 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:08.420281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-ed1de17e-68f4-4407-b088-286abdfeddfb tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:08.421162 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-ed1de17e-68f4-4407-b088-286abdfeddfb tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:08.437587 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ed1de17e-68f4-4407-b088-286abdfeddfb tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:08.438104 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ed1de17e-68f4-4407-b088-286abdfeddfb tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:08.439129 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ed1de17e-68f4-4407-b088-286abdfeddfb tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:08.440566 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ed1de17e-68f4-4407-b088-286abdfeddfb tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:08.441025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ed1de17e-68f4-4407-b088-286abdfeddfb tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:08.441472 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ed1de17e-68f4-4407-b088-286abdfeddfb tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:08.463958 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-501187ff-c7ed-45dd-99e4-14df23669853 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:08.465427 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-501187ff-c7ed-45dd-99e4-14df23669853 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:08.593531 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-501187ff-c7ed-45dd-99e4-14df23669853 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:08.605494 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-501187ff-c7ed-45dd-99e4-14df23669853 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 200 len: 1236 microversion: 2.1 time: 0.145305 Aug 31 09:56:08.626716 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 335/681] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:08 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 1236 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:08.717229 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-ed1de17e-68f4-4407-b088-286abdfeddfb tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:08.726822 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-ed1de17e-68f4-4407-b088-286abdfeddfb tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1566 microversion: 2.1 time: 0.319191 Aug 31 09:56:08.727309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 347/682] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:08 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1566 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:09.631679 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-8d9df195-e21e-4f25-b1bd-aaa1545e71c3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:09.632420 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-8d9df195-e21e-4f25-b1bd-aaa1545e71c3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:09.732829 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-8d9df195-e21e-4f25-b1bd-aaa1545e71c3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:09.751804 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b98ab31b-8eda-471b-87f5-c64a0dbad672 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:09.753152 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b98ab31b-8eda-471b-87f5-c64a0dbad672 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:09.758042 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-8d9df195-e21e-4f25-b1bd-aaa1545e71c3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 200 len: 1236 microversion: 2.1 time: 0.130572 Aug 31 09:56:09.762718 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 336/683] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:09 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 1236 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:09.779533 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b98ab31b-8eda-471b-87f5-c64a0dbad672 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:09.780015 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b98ab31b-8eda-471b-87f5-c64a0dbad672 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:09.780632 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b98ab31b-8eda-471b-87f5-c64a0dbad672 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:09.781541 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b98ab31b-8eda-471b-87f5-c64a0dbad672 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:09.782192 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b98ab31b-8eda-471b-87f5-c64a0dbad672 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:09.782961 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b98ab31b-8eda-471b-87f5-c64a0dbad672 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:09.994539 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b98ab31b-8eda-471b-87f5-c64a0dbad672 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:10.007999 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b98ab31b-8eda-471b-87f5-c64a0dbad672 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1566 microversion: 2.1 time: 0.260843 Aug 31 09:56:10.022820 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 348/684] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:09 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1566 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:10.783270 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-d32d1b89-ff16-4899-8e0f-38737dd69cb7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:10.784015 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-d32d1b89-ff16-4899-8e0f-38737dd69cb7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:10.801440 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d32d1b89-ff16-4899-8e0f-38737dd69cb7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:10.801923 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d32d1b89-ff16-4899-8e0f-38737dd69cb7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:10.802362 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d32d1b89-ff16-4899-8e0f-38737dd69cb7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:10.803120 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d32d1b89-ff16-4899-8e0f-38737dd69cb7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:10.803552 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d32d1b89-ff16-4899-8e0f-38737dd69cb7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:10.803974 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d32d1b89-ff16-4899-8e0f-38737dd69cb7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:10.933546 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-d32d1b89-ff16-4899-8e0f-38737dd69cb7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:10.949577 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-d32d1b89-ff16-4899-8e0f-38737dd69cb7 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 200 len: 1240 microversion: 2.1 time: 0.170716 Aug 31 09:56:10.950757 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 337/685] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:10 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 1240 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:11.030487 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-3c22339e-a57b-49ea-b6e2-32aa5846041b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:11.032816 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-3c22339e-a57b-49ea-b6e2-32aa5846041b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:11.040902 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3c22339e-a57b-49ea-b6e2-32aa5846041b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:11.041784 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3c22339e-a57b-49ea-b6e2-32aa5846041b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:11.042418 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3c22339e-a57b-49ea-b6e2-32aa5846041b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:11.043496 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3c22339e-a57b-49ea-b6e2-32aa5846041b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:11.044173 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3c22339e-a57b-49ea-b6e2-32aa5846041b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:11.044804 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3c22339e-a57b-49ea-b6e2-32aa5846041b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:11.328665 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-3c22339e-a57b-49ea-b6e2-32aa5846041b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:11.345592 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-3c22339e-a57b-49ea-b6e2-32aa5846041b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1566 microversion: 2.1 time: 0.318550 Aug 31 09:56:11.347425 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 349/686] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:11 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1566 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:11.714262 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-1c3f23f4-6e5e-4ee3-9ffd-9a349c1aee5f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:11.714773 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-1c3f23f4-6e5e-4ee3-9ffd-9a349c1aee5f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:11.727070 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1c3f23f4-6e5e-4ee3-9ffd-9a349c1aee5f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:11.727451 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1c3f23f4-6e5e-4ee3-9ffd-9a349c1aee5f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:11.727901 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1c3f23f4-6e5e-4ee3-9ffd-9a349c1aee5f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:11.732258 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1c3f23f4-6e5e-4ee3-9ffd-9a349c1aee5f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:11.737119 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1c3f23f4-6e5e-4ee3-9ffd-9a349c1aee5f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:11.737617 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1c3f23f4-6e5e-4ee3-9ffd-9a349c1aee5f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:11.781798 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-1c3f23f4-6e5e-4ee3-9ffd-9a349c1aee5f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Going to try to terminate instance {{(pid=127171) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:56:11.950910 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-1c3f23f4-6e5e-4ee3-9ffd-9a349c1aee5f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "DELETE /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 204 len: 0 microversion: 2.1 time: 0.240608 Aug 31 09:56:11.951835 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 338/687] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 09:56:11 2022] DELETE /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:56:11.962875 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-7ece8b09-5c70-4b79-b345-2a5f4f7b5e45 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:11.963941 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-7ece8b09-5c70-4b79-b345-2a5f4f7b5e45 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:11.977847 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7ece8b09-5c70-4b79-b345-2a5f4f7b5e45 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:11.978349 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7ece8b09-5c70-4b79-b345-2a5f4f7b5e45 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:11.978999 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7ece8b09-5c70-4b79-b345-2a5f4f7b5e45 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:11.980052 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7ece8b09-5c70-4b79-b345-2a5f4f7b5e45 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:11.980659 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7ece8b09-5c70-4b79-b345-2a5f4f7b5e45 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:11.981149 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7ece8b09-5c70-4b79-b345-2a5f4f7b5e45 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:12.162406 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-e62162ff-f016-4e54-977f-428b7810c78a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Action: 'create', calling method: .version_select at 0x7f5503dacee0>, body: {"keypair": {"name": "tempest-keypair-552878975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0y7uwRAac/mqKDclds++9PoY3ErN8w79XdOYwjkKTuwXKM8EO2aspHBuJOFUQcxK2ERAYd5Ig2Rf10J+cc5wISDwJ59PBhHwrX+tLwZPivD45tYPKFzTIqNG+IjxhO2Q=="}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:12.181169 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-e62162ff-f016-4e54-977f-428b7810c78a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Getting quotas for project a68bf51dcd404f559e9ae2efeb185712. Resources: {'key_pairs'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:56:12.186217 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-e62162ff-f016-4e54-977f-428b7810c78a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Getting quotas for user 6dc6f70f3b1b40d9be1f9d01da0de1f1 and project a68bf51dcd404f559e9ae2efeb185712. Resources: {'key_pairs'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:56:12.196424 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7ece8b09-5c70-4b79-b345-2a5f4f7b5e45 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:12.208486 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-7ece8b09-5c70-4b79-b345-2a5f4f7b5e45 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1576 microversion: 2.1 time: 0.250585 Aug 31 09:56:12.209531 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 339/688] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:11 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1576 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:12.215492 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-94ef487b-1f40-4603-9622-5bde94bc50cd tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:12.216104 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-94ef487b-1f40-4603-9622-5bde94bc50cd tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:12.225491 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-94ef487b-1f40-4603-9622-5bde94bc50cd tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:12.225646 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-e62162ff-f016-4e54-977f-428b7810c78a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.283341 Aug 31 09:56:12.226497 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-94ef487b-1f40-4603-9622-5bde94bc50cd tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:12.226632 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 350/689] 10.222.0.13 () {62 vars in 1200 bytes} [Wed Aug 31 09:56:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 285 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 09:56:12.226722 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-94ef487b-1f40-4603-9622-5bde94bc50cd tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:12.227426 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-94ef487b-1f40-4603-9622-5bde94bc50cd tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:12.227915 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-94ef487b-1f40-4603-9622-5bde94bc50cd tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:12.228320 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-94ef487b-1f40-4603-9622-5bde94bc50cd tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:12.322693 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-94ef487b-1f40-4603-9622-5bde94bc50cd tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:12.333320 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-94ef487b-1f40-4603-9622-5bde94bc50cd tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 200 len: 1288 microversion: 2.1 time: 0.121935 Aug 31 09:56:12.334089 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 340/690] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:12 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 1288 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:12.368217 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-9fb4a3d3-de55-4d24-82d5-0b2b66295221 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:12.369216 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-9fb4a3d3-de55-4d24-82d5-0b2b66295221 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:12.377728 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9fb4a3d3-de55-4d24-82d5-0b2b66295221 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:12.378320 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9fb4a3d3-de55-4d24-82d5-0b2b66295221 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:12.378828 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9fb4a3d3-de55-4d24-82d5-0b2b66295221 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:12.379658 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9fb4a3d3-de55-4d24-82d5-0b2b66295221 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:12.380188 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9fb4a3d3-de55-4d24-82d5-0b2b66295221 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:12.380846 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9fb4a3d3-de55-4d24-82d5-0b2b66295221 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:12.620721 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-9fb4a3d3-de55-4d24-82d5-0b2b66295221 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:12.631048 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-9fb4a3d3-de55-4d24-82d5-0b2b66295221 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1566 microversion: 2.1 time: 0.266962 Aug 31 09:56:12.631660 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 351/691] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:12 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1566 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:13.230724 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-e9f413c6-d0e0-4f72-915f-1db041f1ec05 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:13.231380 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-e9f413c6-d0e0-4f72-915f-1db041f1ec05 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:13.243384 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e9f413c6-d0e0-4f72-915f-1db041f1ec05 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:13.244362 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e9f413c6-d0e0-4f72-915f-1db041f1ec05 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:13.253557 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e9f413c6-d0e0-4f72-915f-1db041f1ec05 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:13.254952 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e9f413c6-d0e0-4f72-915f-1db041f1ec05 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:13.255642 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e9f413c6-d0e0-4f72-915f-1db041f1ec05 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:13.256174 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e9f413c6-d0e0-4f72-915f-1db041f1ec05 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:13.355519 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-8c784995-6613-4f8d-9304-ce1106d1e76c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:13.356056 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-8c784995-6613-4f8d-9304-ce1106d1e76c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:13.363785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8c784995-6613-4f8d-9304-ce1106d1e76c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:13.364826 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8c784995-6613-4f8d-9304-ce1106d1e76c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:13.365605 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8c784995-6613-4f8d-9304-ce1106d1e76c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:13.366759 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8c784995-6613-4f8d-9304-ce1106d1e76c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:13.367497 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8c784995-6613-4f8d-9304-ce1106d1e76c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:13.368070 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8c784995-6613-4f8d-9304-ce1106d1e76c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:13.474398 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-8c784995-6613-4f8d-9304-ce1106d1e76c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:13.479679 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-e9f413c6-d0e0-4f72-915f-1db041f1ec05 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:13.489143 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-8c784995-6613-4f8d-9304-ce1106d1e76c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 200 len: 1288 microversion: 2.1 time: 0.137919 Aug 31 09:56:13.490096 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-e9f413c6-d0e0-4f72-915f-1db041f1ec05 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1576 microversion: 2.1 time: 0.262922 Aug 31 09:56:13.491174 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 352/692] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:13 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 1288 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:13.507705 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 341/693] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:13 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1576 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:13.661462 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-4339122d-ea8b-4509-b86d-4bab98bfcae7 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:13.665673 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-4339122d-ea8b-4509-b86d-4bab98bfcae7 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:13.672025 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4339122d-ea8b-4509-b86d-4bab98bfcae7 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:13.672504 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4339122d-ea8b-4509-b86d-4bab98bfcae7 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:13.674582 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4339122d-ea8b-4509-b86d-4bab98bfcae7 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:13.674771 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4339122d-ea8b-4509-b86d-4bab98bfcae7 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:13.675224 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4339122d-ea8b-4509-b86d-4bab98bfcae7 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:13.675645 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4339122d-ea8b-4509-b86d-4bab98bfcae7 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:13.855383 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-4339122d-ea8b-4509-b86d-4bab98bfcae7 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:13.875021 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-4339122d-ea8b-4509-b86d-4bab98bfcae7 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1566 microversion: 2.1 time: 0.217974 Aug 31 09:56:13.877610 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 353/694] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:13 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1566 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:13.968919 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-8189678f-61cd-49ae-be5a-0c7b4a1fc818 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1879080582", "imageRef": "8e078bb9-f274-4984-8128-d31407d49604", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0f5370f1-004e-40df-a622-c79b4bbd1b36"}], "security_groups": [{"name": "tempest-securitygroup--2050139023"}], "key_name": "tempest-keypair-552878975", "user_data": "}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:14.096306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.network.neutron [None req-8189678f-61cd-49ae-be5a-0c7b4a1fc818 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] validate_networks() for [('0f5370f1-004e-40df-a622-c79b4bbd1b36', None, None, None, None, None)] {{(pid=127171) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:56:14.514094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-fe2b3509-8b52-4356-8430-c33c1ce9af6e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:14.515352 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-fe2b3509-8b52-4356-8430-c33c1ce9af6e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:14.524403 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fe2b3509-8b52-4356-8430-c33c1ce9af6e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:14.527406 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fe2b3509-8b52-4356-8430-c33c1ce9af6e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:14.528128 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fe2b3509-8b52-4356-8430-c33c1ce9af6e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:14.529022 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fe2b3509-8b52-4356-8430-c33c1ce9af6e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:14.529897 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fe2b3509-8b52-4356-8430-c33c1ce9af6e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:14.531239 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fe2b3509-8b52-4356-8430-c33c1ce9af6e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:14.724616 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-fe2b3509-8b52-4356-8430-c33c1ce9af6e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:14.745108 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-fe2b3509-8b52-4356-8430-c33c1ce9af6e tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 200 len: 1296 microversion: 2.1 time: 0.236510 Aug 31 09:56:14.747020 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 354/695] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:14 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 1296 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:14.755122 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-ef3c000f-d612-4af3-a957-3678748f790b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:14.756189 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-ef3c000f-d612-4af3-a957-3678748f790b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:14.764417 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:14.768214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ef3c000f-d612-4af3-a957-3678748f790b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:14.769516 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ef3c000f-d612-4af3-a957-3678748f790b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:14.770189 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ef3c000f-d612-4af3-a957-3678748f790b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:14.771300 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ef3c000f-d612-4af3-a957-3678748f790b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:14.772040 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ef3c000f-d612-4af3-a957-3678748f790b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:14.772684 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ef3c000f-d612-4af3-a957-3678748f790b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:14.861268 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-8189678f-61cd-49ae-be5a-0c7b4a1fc818 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Flavor limits 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:56:14.861932 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-8189678f-61cd-49ae-be5a-0c7b4a1fc818 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Image limits 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:56:14.862608 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-8189678f-61cd-49ae-be5a-0c7b4a1fc818 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Flavor pref 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:56:14.863197 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-8189678f-61cd-49ae-be5a-0c7b4a1fc818 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Image pref 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:56:14.863789 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-8189678f-61cd-49ae-be5a-0c7b4a1fc818 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:56:14.876648 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8189678f-61cd-49ae-be5a-0c7b4a1fc818 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:14.877516 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8189678f-61cd-49ae-be5a-0c7b4a1fc818 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:14.878688 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8189678f-61cd-49ae-be5a-0c7b4a1fc818 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:14.879651 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8189678f-61cd-49ae-be5a-0c7b4a1fc818 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:14.880295 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8189678f-61cd-49ae-be5a-0c7b4a1fc818 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:14.880895 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8189678f-61cd-49ae-be5a-0c7b4a1fc818 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:14.920862 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-8189678f-61cd-49ae-be5a-0c7b4a1fc818 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Getting quotas for project a68bf51dcd404f559e9ae2efeb185712. Resources: {'ram', 'instances', 'cores'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:56:14.928756 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-8189678f-61cd-49ae-be5a-0c7b4a1fc818 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Getting quotas for user 6dc6f70f3b1b40d9be1f9d01da0de1f1 and project a68bf51dcd404f559e9ae2efeb185712. Resources: {'ram', 'instances', 'cores'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:56:14.954848 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-8189678f-61cd-49ae-be5a-0c7b4a1fc818 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Going to run 1 instances... {{(pid=127171) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:56:14.957792 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-8189678f-61cd-49ae-be5a-0c7b4a1fc818 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8e078bb9-f274-4984-8128-d31407d49604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:56:15.067637 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-8189678f-61cd-49ae-be5a-0c7b4a1fc818 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.102970 Aug 31 09:56:15.073354 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 342/696] 10.222.0.13 () {62 vars in 1188 bytes} [Wed Aug 31 09:56:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 09:56:15.093134 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c84c8074-b896-468d-a324-d1a9892c29b3 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:15.095285 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c84c8074-b896-468d-a324-d1a9892c29b3 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:15.104023 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c84c8074-b896-468d-a324-d1a9892c29b3 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:15.104527 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c84c8074-b896-468d-a324-d1a9892c29b3 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:15.104971 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c84c8074-b896-468d-a324-d1a9892c29b3 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:15.105825 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c84c8074-b896-468d-a324-d1a9892c29b3 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:15.106280 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c84c8074-b896-468d-a324-d1a9892c29b3 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:15.106731 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c84c8074-b896-468d-a324-d1a9892c29b3 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:15.284869 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-ef3c000f-d612-4af3-a957-3678748f790b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:15.296166 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-ef3c000f-d612-4af3-a957-3678748f790b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1576 microversion: 2.1 time: 0.546051 Aug 31 09:56:15.297009 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 355/697] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:14 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1576 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:15.306541 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-99c8d122-4c86-4c55-87bc-d473827ea772 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:15.307602 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-99c8d122-4c86-4c55-87bc-d473827ea772 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:15.428972 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-99c8d122-4c86-4c55-87bc-d473827ea772 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:15.445966 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-99c8d122-4c86-4c55-87bc-d473827ea772 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:15.447473 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-99c8d122-4c86-4c55-87bc-d473827ea772 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:15.448534 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-99c8d122-4c86-4c55-87bc-d473827ea772 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1281 microversion: 2.20 time: 0.146790 Aug 31 09:56:15.449436 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 356/698] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:15 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1281 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:15.505013 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c84c8074-b896-468d-a324-d1a9892c29b3 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:15.513663 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c84c8074-b896-468d-a324-d1a9892c29b3 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1566 microversion: 2.1 time: 0.438475 Aug 31 09:56:15.525467 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 343/699] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:15 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1566 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:15.770746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-690b8e69-ec1b-4ded-b029-fa0df4d2a270 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:15.771488 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-690b8e69-ec1b-4ded-b029-fa0df4d2a270 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:15.782305 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-690b8e69-ec1b-4ded-b029-fa0df4d2a270 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:15.783128 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-690b8e69-ec1b-4ded-b029-fa0df4d2a270 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:15.783722 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-690b8e69-ec1b-4ded-b029-fa0df4d2a270 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:15.784657 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-690b8e69-ec1b-4ded-b029-fa0df4d2a270 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:15.785515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-690b8e69-ec1b-4ded-b029-fa0df4d2a270 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:15.786119 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-690b8e69-ec1b-4ded-b029-fa0df4d2a270 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:15.989623 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-7b76e40f-6b99-4d5a-864d-58e673d33f8a req-9aa45b44-aa81-4b8b-9886-3847aeff57cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb177fd-40cd-4551-be64-eac4c6283268", "name": "network-vif-deleted", "tag": "84133d6b-1b23-4f48-ad40-3d788d6effc7"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:16.007226 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:16.024821 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-7b76e40f-6b99-4d5a-864d-58e673d33f8a req-9aa45b44-aa81-4b8b-9886-3847aeff57cf service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:16.026039 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-7b76e40f-6b99-4d5a-864d-58e673d33f8a req-9aa45b44-aa81-4b8b-9886-3847aeff57cf service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:16.028830 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-7b76e40f-6b99-4d5a-864d-58e673d33f8a req-9aa45b44-aa81-4b8b-9886-3847aeff57cf service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:16.068054 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-7b76e40f-6b99-4d5a-864d-58e673d33f8a req-9aa45b44-aa81-4b8b-9886-3847aeff57cf service nova] Creating event network-vif-deleted:84133d6b-1b23-4f48-ad40-3d788d6effc7 for instance eeb177fd-40cd-4551-be64-eac4c6283268 on hv-cinder-84496 Aug 31 09:56:16.083966 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-7b76e40f-6b99-4d5a-864d-58e673d33f8a req-9aa45b44-aa81-4b8b-9886-3847aeff57cf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099720 Aug 31 09:56:16.085218 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 344/700] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:56:16.144903 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=2 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:16.220271 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-690b8e69-ec1b-4ded-b029-fa0df4d2a270 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:16.228773 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-690b8e69-ec1b-4ded-b029-fa0df4d2a270 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 200 len: 1294 microversion: 2.1 time: 0.465187 Aug 31 09:56:16.229747 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 357/701] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:15 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 1294 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:16.320112 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-84bcc4f3-a8fb-4c99-87e2-7fe52e263b96 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:16.321705 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-84bcc4f3-a8fb-4c99-87e2-7fe52e263b96 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:16.336357 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-84bcc4f3-a8fb-4c99-87e2-7fe52e263b96 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:16.336956 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-84bcc4f3-a8fb-4c99-87e2-7fe52e263b96 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:16.337540 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-84bcc4f3-a8fb-4c99-87e2-7fe52e263b96 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:16.338498 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-84bcc4f3-a8fb-4c99-87e2-7fe52e263b96 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:16.339021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-84bcc4f3-a8fb-4c99-87e2-7fe52e263b96 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:16.339542 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-84bcc4f3-a8fb-4c99-87e2-7fe52e263b96 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:16.475377 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f291795e-2dc0-494a-8eb4-3a776a63ff20 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:16.476007 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-f291795e-2dc0-494a-8eb4-3a776a63ff20 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:16.476521 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-84bcc4f3-a8fb-4c99-87e2-7fe52e263b96 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:16.496236 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f291795e-2dc0-494a-8eb4-3a776a63ff20 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:16.497736 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f291795e-2dc0-494a-8eb4-3a776a63ff20 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:16.497985 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-84bcc4f3-a8fb-4c99-87e2-7fe52e263b96 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1225 microversion: 2.1 time: 0.182448 Aug 31 09:56:16.499783 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f291795e-2dc0-494a-8eb4-3a776a63ff20 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:16.500137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 345/702] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:16 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1225 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:16.507587 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f291795e-2dc0-494a-8eb4-3a776a63ff20 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:16.510032 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f291795e-2dc0-494a-8eb4-3a776a63ff20 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:16.510492 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f291795e-2dc0-494a-8eb4-3a776a63ff20 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:16.544123 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-22c37b1b-86cc-4379-99ad-3af717e51e27 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:16.544746 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-22c37b1b-86cc-4379-99ad-3af717e51e27 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:16.557495 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-22c37b1b-86cc-4379-99ad-3af717e51e27 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:16.562250 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-22c37b1b-86cc-4379-99ad-3af717e51e27 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:16.562777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-22c37b1b-86cc-4379-99ad-3af717e51e27 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:16.564155 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-22c37b1b-86cc-4379-99ad-3af717e51e27 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:16.564747 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-22c37b1b-86cc-4379-99ad-3af717e51e27 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:16.565107 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-22c37b1b-86cc-4379-99ad-3af717e51e27 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:16.598810 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-f291795e-2dc0-494a-8eb4-3a776a63ff20 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:16.611815 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-f291795e-2dc0-494a-8eb4-3a776a63ff20 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:16.612910 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-f291795e-2dc0-494a-8eb4-3a776a63ff20 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:16.614110 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-f291795e-2dc0-494a-8eb4-3a776a63ff20 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1333 microversion: 2.20 time: 0.142664 Aug 31 09:56:16.614681 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 358/703] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:16 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1333 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:16.790563 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-22c37b1b-86cc-4379-99ad-3af717e51e27 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:16.795105 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:16.811160 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-22c37b1b-86cc-4379-99ad-3af717e51e27 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1566 microversion: 2.1 time: 0.274206 Aug 31 09:56:16.812547 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 346/704] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:16 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1566 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:17.253287 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-6008dda7-5df4-4444-a575-719961db995c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:17.253952 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-6008dda7-5df4-4444-a575-719961db995c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:17.270759 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6008dda7-5df4-4444-a575-719961db995c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:17.271527 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6008dda7-5df4-4444-a575-719961db995c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:17.272248 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6008dda7-5df4-4444-a575-719961db995c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:17.273344 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6008dda7-5df4-4444-a575-719961db995c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:17.274052 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6008dda7-5df4-4444-a575-719961db995c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:17.274855 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6008dda7-5df4-4444-a575-719961db995c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:17.533690 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-a51aa700-c6c3-47c2-968d-7f2be0880c89 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:17.534938 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-a51aa700-c6c3-47c2-968d-7f2be0880c89 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:17.544050 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a51aa700-c6c3-47c2-968d-7f2be0880c89 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:17.544822 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a51aa700-c6c3-47c2-968d-7f2be0880c89 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:17.545637 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a51aa700-c6c3-47c2-968d-7f2be0880c89 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:17.546508 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a51aa700-c6c3-47c2-968d-7f2be0880c89 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:17.547257 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a51aa700-c6c3-47c2-968d-7f2be0880c89 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:17.548054 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a51aa700-c6c3-47c2-968d-7f2be0880c89 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:17.580725 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-6008dda7-5df4-4444-a575-719961db995c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:17.589566 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-6008dda7-5df4-4444-a575-719961db995c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 200 len: 1362 microversion: 2.1 time: 0.340403 Aug 31 09:56:17.604491 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 359/705] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:17 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:17.610088 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a51aa700-c6c3-47c2-968d-7f2be0880c89 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:17.610745 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a51aa700-c6c3-47c2-968d-7f2be0880c89 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:17.611273 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a51aa700-c6c3-47c2-968d-7f2be0880c89 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:17.611743 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.objects.instance [None req-a51aa700-c6c3-47c2-968d-7f2be0880c89 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lazy-loading 'fault' on Instance uuid eeb177fd-40cd-4551-be64-eac4c6283268 {{(pid=127171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:56:17.645769 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-bb8c4e9d-07e6-4c3c-bd95-588010384102 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:17.647531 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-bb8c4e9d-07e6-4c3c-bd95-588010384102 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:17.657644 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bb8c4e9d-07e6-4c3c-bd95-588010384102 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:17.658423 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bb8c4e9d-07e6-4c3c-bd95-588010384102 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:17.659114 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bb8c4e9d-07e6-4c3c-bd95-588010384102 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:17.660258 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bb8c4e9d-07e6-4c3c-bd95-588010384102 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:17.660962 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bb8c4e9d-07e6-4c3c-bd95-588010384102 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:17.661676 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bb8c4e9d-07e6-4c3c-bd95-588010384102 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:17.683008 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-a51aa700-c6c3-47c2-968d-7f2be0880c89 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:17.695500 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-a51aa700-c6c3-47c2-968d-7f2be0880c89 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 200 len: 1230 microversion: 2.1 time: 0.177395 Aug 31 09:56:17.712558 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 347/706] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:17 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 1230 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:17.797006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-bb8c4e9d-07e6-4c3c-bd95-588010384102 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:17.810873 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-bb8c4e9d-07e6-4c3c-bd95-588010384102 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:17.812715 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-bb8c4e9d-07e6-4c3c-bd95-588010384102 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:17.814943 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-bb8c4e9d-07e6-4c3c-bd95-588010384102 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1339 microversion: 2.20 time: 0.177901 Aug 31 09:56:17.816179 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 360/707] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:17 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1339 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:17.839415 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-317020c4-d6b0-40b9-8f04-739b0a366c1d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:17.840328 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-317020c4-d6b0-40b9-8f04-739b0a366c1d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:17.856574 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-317020c4-d6b0-40b9-8f04-739b0a366c1d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:17.857250 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-317020c4-d6b0-40b9-8f04-739b0a366c1d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:17.858507 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-317020c4-d6b0-40b9-8f04-739b0a366c1d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:17.859634 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-317020c4-d6b0-40b9-8f04-739b0a366c1d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:17.860180 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-317020c4-d6b0-40b9-8f04-739b0a366c1d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:17.860611 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-317020c4-d6b0-40b9-8f04-739b0a366c1d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:18.113916 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-317020c4-d6b0-40b9-8f04-739b0a366c1d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:18.125705 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-317020c4-d6b0-40b9-8f04-739b0a366c1d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1566 microversion: 2.1 time: 0.289647 Aug 31 09:56:18.127784 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 348/708] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:17 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1566 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:18.149470 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-7cf6f12f-ea66-4d41-bd5d-f23420c86715 req-bb236017-4f3b-46d8-bc87-7dced7d8edac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dad5a844-b1e2-4310-919c-7d3a334cc794", "tag": "faf14e51-3e45-4bef-906c-896093d3aeda"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:18.158906 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-7cf6f12f-ea66-4d41-bd5d-f23420c86715 req-bb236017-4f3b-46d8-bc87-7dced7d8edac service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:18.159378 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-7cf6f12f-ea66-4d41-bd5d-f23420c86715 req-bb236017-4f3b-46d8-bc87-7dced7d8edac service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:18.159796 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-7cf6f12f-ea66-4d41-bd5d-f23420c86715 req-bb236017-4f3b-46d8-bc87-7dced7d8edac service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:18.163828 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=100 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:18.171942 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-7cf6f12f-ea66-4d41-bd5d-f23420c86715 req-bb236017-4f3b-46d8-bc87-7dced7d8edac service nova] Creating event network-changed:faf14e51-3e45-4bef-906c-896093d3aeda for instance dad5a844-b1e2-4310-919c-7d3a334cc794 on hv-cinder-84496 Aug 31 09:56:18.177834 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-7cf6f12f-ea66-4d41-bd5d-f23420c86715 req-bb236017-4f3b-46d8-bc87-7dced7d8edac service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031831 Aug 31 09:56:18.178959 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 361/709] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:56:18.614143 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-e26a2542-8d24-4492-b35d-7c559b8700b9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:18.617744 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-e26a2542-8d24-4492-b35d-7c559b8700b9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:18.625075 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e26a2542-8d24-4492-b35d-7c559b8700b9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:18.625731 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e26a2542-8d24-4492-b35d-7c559b8700b9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:18.626386 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e26a2542-8d24-4492-b35d-7c559b8700b9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:18.627442 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e26a2542-8d24-4492-b35d-7c559b8700b9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:18.627981 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e26a2542-8d24-4492-b35d-7c559b8700b9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:18.628709 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e26a2542-8d24-4492-b35d-7c559b8700b9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:18.717156 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-302a2bee-03f6-47f6-b097-a5e909d42611 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:18.717975 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-302a2bee-03f6-47f6-b097-a5e909d42611 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:18.725391 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-302a2bee-03f6-47f6-b097-a5e909d42611 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:18.726070 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-302a2bee-03f6-47f6-b097-a5e909d42611 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:18.726699 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-302a2bee-03f6-47f6-b097-a5e909d42611 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:18.727666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-302a2bee-03f6-47f6-b097-a5e909d42611 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:18.728289 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-302a2bee-03f6-47f6-b097-a5e909d42611 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:18.729019 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-302a2bee-03f6-47f6-b097-a5e909d42611 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:18.743617 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-302a2bee-03f6-47f6-b097-a5e909d42611 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] HTTP exception thrown: Instance eeb177fd-40cd-4551-be64-eac4c6283268 could not be found. Aug 31 09:56:18.745261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-302a2bee-03f6-47f6-b097-a5e909d42611 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Request method failure captured: Aug 31 09:56:18.745261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 HTTP/1.1 Aug 31 09:56:18.745261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 09:56:18.745261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 09:56:18.745261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 09:56:18.745261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 09:56:18.745261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 09:56:18.745261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 09:56:18.745261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 09:56:18.745261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 09:56:18.745261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy8YM8ci4vJFSG2lkdgV6Rh_nuRKXUqmeqeZAL9vYbqbNzI1QNyOdQ0H5CFETxxLVWM61BTVD241o3KesAgNLhocpiyzw017AQvOtzW_QAabNtgMEfwUu5XnGt7kiD2OZWO5bcf9w6hB6idU7QVGakMClAMCkVi56Bi857_Vz8Zs6PQ Aug 31 09:56:18.745261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 09:56:18.745261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 09:56:18.745261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 09:56:18.745261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 09:56:18.745261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 09:56:18.745261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 09:56:18.745261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: 6634173c9d534fca800d394d545a9d0c Aug 31 09:56:18.745261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-TestVolumeBootPattern-854801384 Aug 31 09:56:18.745261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 09:56:18.745261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 09:56:18.746959 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6634173c9d534fca800d394d545a9d0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6634173c9d534fca800d394d545a9d0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6634173c9d534fca800d394d545a9d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6634173c9d534fca800d394d545a9d0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:56:18.746959 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-TestVolumeBootPattern-854801384 Aug 31 09:56:18.746959 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: 6634173c9d534fca800d394d545a9d0c Aug 31 09:56:18.746959 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-TestVolumeBootPattern-854801384 Aug 31 09:56:18.746959 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-TestVolumeBootPattern-854801384-project Aug 31 09:56:18.746959 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 09:56:18.746959 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 09:56:18.746959 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: 1090c027746845239055973b44207556 Aug 31 09:56:18.746959 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-TestVolumeBootPattern-854801384-project Aug 31 09:56:18.746959 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 09:56:18.746959 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Instance eeb177fd-40cd-4551-be64-eac4c6283268 could not be found. Aug 31 09:56:18.746959 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': 'eeb177fd-40cd-4551-be64-eac4c6283268'} Aug 31 09:56:18.748004 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:56:18.748004 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:18.748004 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:56:18.748004 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:56:18.748004 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:56:18.748004 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:56:18.748004 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:56:18.748004 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:56:18.748004 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:56:18.748004 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:56:18.748004 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeb177fd-40cd-4551-be64-eac4c6283268 could not be found. Aug 31 09:56:18.748004 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:56:18.748004 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:18.748004 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:56:18.748004 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:18.748004 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:18.748004 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:18.748004 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:56:18.748004 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:56:18.748004 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:56:18.749574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:56:18.749574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:56:18.749574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:56:18.749574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:56:18.749574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:56:18.749574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:56:18.749574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:56:18.749574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeb177fd-40cd-4551-be64-eac4c6283268 could not be found. Aug 31 09:56:18.749574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:56:18.749574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:18.749574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:56:18.749574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:18.749574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:18.749574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:18.749574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:56:18.749574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:56:18.749574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeb177fd-40cd-4551-be64-eac4c6283268 could not be found. Aug 31 09:56:18.749574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:56:18.751344 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-302a2bee-03f6-47f6-b097-a5e909d42611 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Returning 404 to user: Instance eeb177fd-40cd-4551-be64-eac4c6283268 could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:56:18.751344 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-302a2bee-03f6-47f6-b097-a5e909d42611 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 404 len: 111 microversion: 2.1 time: 0.034198 Aug 31 09:56:18.756207 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 362/710] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:18 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 09:56:18.813638 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-e26a2542-8d24-4492-b35d-7c559b8700b9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:18.829904 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-e26a2542-8d24-4492-b35d-7c559b8700b9 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 200 len: 1362 microversion: 2.1 time: 0.218372 Aug 31 09:56:18.830845 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 349/711] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:18 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:18.844225 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-447185aa-1555-4079-8842-335a32bdb006 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:18.844225 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-447185aa-1555-4079-8842-335a32bdb006 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:18.857103 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-447185aa-1555-4079-8842-335a32bdb006 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:18.858000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-447185aa-1555-4079-8842-335a32bdb006 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:18.858715 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-447185aa-1555-4079-8842-335a32bdb006 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:18.859877 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-447185aa-1555-4079-8842-335a32bdb006 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:18.860491 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-447185aa-1555-4079-8842-335a32bdb006 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:18.861081 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-447185aa-1555-4079-8842-335a32bdb006 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:18.887090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-630d1733-76fc-484c-8508-2ef7b3176932 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-608628764", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-235501854", "security_groups": [{"name": "tempest-secgroup-smoke-1528914323"}], "block_device_mapping_v2": [{"uuid": "143050a6-06e1-4d09-ab0e-e18840569eb5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b98f4fc3-1d55-4d78-8d5f-4e68e4b2b75a"}]}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:19.265556 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.network.neutron [None req-630d1733-76fc-484c-8508-2ef7b3176932 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] validate_networks() for [('b98f4fc3-1d55-4d78-8d5f-4e68e4b2b75a', None, None, None, None, None)] {{(pid=127171) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:56:19.397747 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-447185aa-1555-4079-8842-335a32bdb006 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:19.410614 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-447185aa-1555-4079-8842-335a32bdb006 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:19.414248 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-447185aa-1555-4079-8842-335a32bdb006 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:19.415713 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-447185aa-1555-4079-8842-335a32bdb006 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1407 microversion: 2.20 time: 0.577362 Aug 31 09:56:19.416448 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 363/712] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:18 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1407 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:56:19.421162 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-8311940a-65c6-45bf-919d-67b0023be019 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:19.422130 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-8311940a-65c6-45bf-919d-67b0023be019 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:19.429175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8311940a-65c6-45bf-919d-67b0023be019 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:19.429920 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8311940a-65c6-45bf-919d-67b0023be019 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:19.430517 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8311940a-65c6-45bf-919d-67b0023be019 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:19.431385 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8311940a-65c6-45bf-919d-67b0023be019 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:19.432127 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8311940a-65c6-45bf-919d-67b0023be019 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:19.432548 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8311940a-65c6-45bf-919d-67b0023be019 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:19.785250 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-8311940a-65c6-45bf-919d-67b0023be019 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:19.793609 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-8311940a-65c6-45bf-919d-67b0023be019 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1566 microversion: 2.1 time: 0.375972 Aug 31 09:56:19.794267 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 364/713] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:19 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1566 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:19.799741 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-36446f4f-8411-4b17-909c-35ba1a0a5c80 req-66b940ea-cf4a-47d9-8498-4c995d38001b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9", "tag": "f0ab5d21-97ec-4a21-a75b-253b40f65e47"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:19.811739 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-36446f4f-8411-4b17-909c-35ba1a0a5c80 req-66b940ea-cf4a-47d9-8498-4c995d38001b service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:19.812212 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-36446f4f-8411-4b17-909c-35ba1a0a5c80 req-66b940ea-cf4a-47d9-8498-4c995d38001b service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:19.812787 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-36446f4f-8411-4b17-909c-35ba1a0a5c80 req-66b940ea-cf4a-47d9-8498-4c995d38001b service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:19.826137 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-36446f4f-8411-4b17-909c-35ba1a0a5c80 req-66b940ea-cf4a-47d9-8498-4c995d38001b service nova] Creating event network-changed:f0ab5d21-97ec-4a21-a75b-253b40f65e47 for instance b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 on hv-cinder-84496 Aug 31 09:56:19.830972 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-36446f4f-8411-4b17-909c-35ba1a0a5c80 req-66b940ea-cf4a-47d9-8498-4c995d38001b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035555 Aug 31 09:56:19.831573 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 365/714] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:56:19.852549 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-cb74f888-a6b6-4297-8968-f6fd52f676d2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:19.852948 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-cb74f888-a6b6-4297-8968-f6fd52f676d2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:19.859809 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb74f888-a6b6-4297-8968-f6fd52f676d2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:19.860835 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb74f888-a6b6-4297-8968-f6fd52f676d2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:19.861262 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb74f888-a6b6-4297-8968-f6fd52f676d2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:19.862012 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb74f888-a6b6-4297-8968-f6fd52f676d2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:19.862504 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb74f888-a6b6-4297-8968-f6fd52f676d2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:19.862860 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb74f888-a6b6-4297-8968-f6fd52f676d2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:20.064786 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-630d1733-76fc-484c-8508-2ef7b3176932 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Flavor limits 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:56:20.065281 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-630d1733-76fc-484c-8508-2ef7b3176932 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Image limits 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:56:20.065699 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-630d1733-76fc-484c-8508-2ef7b3176932 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Flavor pref 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:56:20.066109 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-630d1733-76fc-484c-8508-2ef7b3176932 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Image pref 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:56:20.066521 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-630d1733-76fc-484c-8508-2ef7b3176932 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:56:20.073085 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-cb74f888-a6b6-4297-8968-f6fd52f676d2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:20.075999 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-630d1733-76fc-484c-8508-2ef7b3176932 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:20.076470 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-630d1733-76fc-484c-8508-2ef7b3176932 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:20.076899 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-630d1733-76fc-484c-8508-2ef7b3176932 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:20.077647 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-630d1733-76fc-484c-8508-2ef7b3176932 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:20.078086 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-630d1733-76fc-484c-8508-2ef7b3176932 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:20.078500 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-630d1733-76fc-484c-8508-2ef7b3176932 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:20.082621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-cb74f888-a6b6-4297-8968-f6fd52f676d2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 200 len: 1362 microversion: 2.1 time: 0.234813 Aug 31 09:56:20.083278 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 366/715] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:19 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:20.098679 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-630d1733-76fc-484c-8508-2ef7b3176932 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Getting quotas for project 6634173c9d534fca800d394d545a9d0c. Resources: {'ram', 'instances', 'cores'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:56:20.103092 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-630d1733-76fc-484c-8508-2ef7b3176932 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Getting quotas for user 1090c027746845239055973b44207556 and project 6634173c9d534fca800d394d545a9d0c. Resources: {'ram', 'instances', 'cores'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:56:20.161661 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-630d1733-76fc-484c-8508-2ef7b3176932 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Going to run 1 instances... {{(pid=127171) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:56:20.163880 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-630d1733-76fc-484c-8508-2ef7b3176932 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='143050a6-06e1-4d09-ab0e-e18840569eb5',volume_size=None,volume_type=None)] {{(pid=127171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:56:20.306600 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-630d1733-76fc-484c-8508-2ef7b3176932 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.426063 Aug 31 09:56:20.307546 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 350/716] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 31 09:56:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 1427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 09:56:20.319213 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-88f03091-e11c-4be7-9e96-ec90e2d4e431 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:20.319823 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-88f03091-e11c-4be7-9e96-ec90e2d4e431 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:20.377567 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-88f03091-e11c-4be7-9e96-ec90e2d4e431 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:20.385531 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-88f03091-e11c-4be7-9e96-ec90e2d4e431 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1093 microversion: 2.1 time: 0.070358 Aug 31 09:56:20.386228 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 367/717] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:20 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:20.441016 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-771fe74a-81f9-4e95-adba-b1c774aed8f1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:20.441599 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-771fe74a-81f9-4e95-adba-b1c774aed8f1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:20.449904 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-771fe74a-81f9-4e95-adba-b1c774aed8f1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:20.450397 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-771fe74a-81f9-4e95-adba-b1c774aed8f1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:20.450834 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-771fe74a-81f9-4e95-adba-b1c774aed8f1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:20.451541 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-771fe74a-81f9-4e95-adba-b1c774aed8f1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:20.451993 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-771fe74a-81f9-4e95-adba-b1c774aed8f1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:20.452437 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-771fe74a-81f9-4e95-adba-b1c774aed8f1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:20.609776 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-771fe74a-81f9-4e95-adba-b1c774aed8f1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:20.619690 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-771fe74a-81f9-4e95-adba-b1c774aed8f1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:20.621194 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-771fe74a-81f9-4e95-adba-b1c774aed8f1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:20.622375 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-771fe74a-81f9-4e95-adba-b1c774aed8f1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1407 microversion: 2.20 time: 0.186532 Aug 31 09:56:20.622922 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 351/718] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:20 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:20.816335 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-acf7d57b-2d90-4912-9862-f4e57f61d745 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:20.816951 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-acf7d57b-2d90-4912-9862-f4e57f61d745 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:20.824146 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-acf7d57b-2d90-4912-9862-f4e57f61d745 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:20.824625 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-acf7d57b-2d90-4912-9862-f4e57f61d745 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:20.825056 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-acf7d57b-2d90-4912-9862-f4e57f61d745 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:20.825806 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-acf7d57b-2d90-4912-9862-f4e57f61d745 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:20.826254 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-acf7d57b-2d90-4912-9862-f4e57f61d745 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:20.826701 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-acf7d57b-2d90-4912-9862-f4e57f61d745 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:20.959463 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-acf7d57b-2d90-4912-9862-f4e57f61d745 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:20.967395 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-acf7d57b-2d90-4912-9862-f4e57f61d745 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1566 microversion: 2.1 time: 0.155738 Aug 31 09:56:20.967997 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 368/719] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:20 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:21.103558 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-886b609d-13d3-460b-b3fd-e45977dbfbca tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:21.104177 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-886b609d-13d3-460b-b3fd-e45977dbfbca tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:21.111321 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-886b609d-13d3-460b-b3fd-e45977dbfbca tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:21.111810 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-886b609d-13d3-460b-b3fd-e45977dbfbca tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:21.112251 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-886b609d-13d3-460b-b3fd-e45977dbfbca tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:21.112940 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-886b609d-13d3-460b-b3fd-e45977dbfbca tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:21.113409 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-886b609d-13d3-460b-b3fd-e45977dbfbca tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:21.113853 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-886b609d-13d3-460b-b3fd-e45977dbfbca tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:21.251081 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-886b609d-13d3-460b-b3fd-e45977dbfbca tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:21.259189 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-886b609d-13d3-460b-b3fd-e45977dbfbca tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 200 len: 1362 microversion: 2.1 time: 0.159462 Aug 31 09:56:21.259755 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 352/720] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:21 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:21.407369 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-47182a41-e3e5-41c6-be1b-495fcac37de6 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:21.407983 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-47182a41-e3e5-41c6-be1b-495fcac37de6 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:21.414587 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-47182a41-e3e5-41c6-be1b-495fcac37de6 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:21.415071 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-47182a41-e3e5-41c6-be1b-495fcac37de6 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:21.415497 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-47182a41-e3e5-41c6-be1b-495fcac37de6 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:21.416175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-47182a41-e3e5-41c6-be1b-495fcac37de6 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:21.416619 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-47182a41-e3e5-41c6-be1b-495fcac37de6 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:21.417033 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-47182a41-e3e5-41c6-be1b-495fcac37de6 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:21.488246 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-47182a41-e3e5-41c6-be1b-495fcac37de6 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:21.496317 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-47182a41-e3e5-41c6-be1b-495fcac37de6 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1143 microversion: 2.1 time: 0.093411 Aug 31 09:56:21.496896 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 369/721] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:21 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1143 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:21.647524 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-bf3aa136-4e3a-4d76-995c-bf1a0445b27a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:21.648049 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-bf3aa136-4e3a-4d76-995c-bf1a0445b27a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:21.654256 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-bf3aa136-4e3a-4d76-995c-bf1a0445b27a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:21.654740 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-bf3aa136-4e3a-4d76-995c-bf1a0445b27a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:21.655178 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-bf3aa136-4e3a-4d76-995c-bf1a0445b27a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:21.655875 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-bf3aa136-4e3a-4d76-995c-bf1a0445b27a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:21.656326 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-bf3aa136-4e3a-4d76-995c-bf1a0445b27a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:21.656849 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-bf3aa136-4e3a-4d76-995c-bf1a0445b27a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:21.806868 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-bf3aa136-4e3a-4d76-995c-bf1a0445b27a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:21.815364 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-bf3aa136-4e3a-4d76-995c-bf1a0445b27a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:21.816833 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-bf3aa136-4e3a-4d76-995c-bf1a0445b27a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:21.818161 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-bf3aa136-4e3a-4d76-995c-bf1a0445b27a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1407 microversion: 2.20 time: 0.174672 Aug 31 09:56:21.818763 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 353/722] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:21 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:21.988469 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-4748fadc-7569-4fd2-8385-8ac18d9227f3 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:21.989093 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-4748fadc-7569-4fd2-8385-8ac18d9227f3 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:21.997208 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4748fadc-7569-4fd2-8385-8ac18d9227f3 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:21.998066 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4748fadc-7569-4fd2-8385-8ac18d9227f3 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:21.998518 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4748fadc-7569-4fd2-8385-8ac18d9227f3 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:21.999225 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4748fadc-7569-4fd2-8385-8ac18d9227f3 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:21.999678 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4748fadc-7569-4fd2-8385-8ac18d9227f3 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:22.000099 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4748fadc-7569-4fd2-8385-8ac18d9227f3 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:22.281815 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-7bc0810f-1173-429a-b89e-8a922a72da88 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:22.289221 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-7bc0810f-1173-429a-b89e-8a922a72da88 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:22.296330 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7bc0810f-1173-429a-b89e-8a922a72da88 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:22.296825 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7bc0810f-1173-429a-b89e-8a922a72da88 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:22.297570 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7bc0810f-1173-429a-b89e-8a922a72da88 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:22.298130 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7bc0810f-1173-429a-b89e-8a922a72da88 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:22.298580 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7bc0810f-1173-429a-b89e-8a922a72da88 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:22.299006 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7bc0810f-1173-429a-b89e-8a922a72da88 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:22.447834 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-4748fadc-7569-4fd2-8385-8ac18d9227f3 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:22.456463 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-4748fadc-7569-4fd2-8385-8ac18d9227f3 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1566 microversion: 2.1 time: 0.472154 Aug 31 09:56:22.457052 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 370/723] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:21 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1566 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:22.518522 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-9d3c298c-fb1a-4332-87a5-8ad7bba50506 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:22.519228 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-9d3c298c-fb1a-4332-87a5-8ad7bba50506 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:22.526005 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9d3c298c-fb1a-4332-87a5-8ad7bba50506 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:22.526584 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9d3c298c-fb1a-4332-87a5-8ad7bba50506 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:22.527043 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9d3c298c-fb1a-4332-87a5-8ad7bba50506 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:22.527942 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9d3c298c-fb1a-4332-87a5-8ad7bba50506 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:22.528384 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9d3c298c-fb1a-4332-87a5-8ad7bba50506 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:22.528803 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9d3c298c-fb1a-4332-87a5-8ad7bba50506 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:22.546340 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7bc0810f-1173-429a-b89e-8a922a72da88 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:22.555206 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-7bc0810f-1173-429a-b89e-8a922a72da88 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 200 len: 1362 microversion: 2.1 time: 0.277664 Aug 31 09:56:22.555776 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 354/724] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:22 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:22.593964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-9d3c298c-fb1a-4332-87a5-8ad7bba50506 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:22.603469 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-9d3c298c-fb1a-4332-87a5-8ad7bba50506 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1135 microversion: 2.1 time: 0.089309 Aug 31 09:56:22.604060 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 371/725] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:22 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1135 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:22.841474 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c12b020c-5ba7-4eaf-a901-edcdf4b84095 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:22.842293 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c12b020c-5ba7-4eaf-a901-edcdf4b84095 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:22.849755 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c12b020c-5ba7-4eaf-a901-edcdf4b84095 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:22.850234 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c12b020c-5ba7-4eaf-a901-edcdf4b84095 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:22.850663 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c12b020c-5ba7-4eaf-a901-edcdf4b84095 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:22.851359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c12b020c-5ba7-4eaf-a901-edcdf4b84095 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:22.851816 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c12b020c-5ba7-4eaf-a901-edcdf4b84095 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:22.852221 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c12b020c-5ba7-4eaf-a901-edcdf4b84095 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:22.999915 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c12b020c-5ba7-4eaf-a901-edcdf4b84095 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:23.008907 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c12b020c-5ba7-4eaf-a901-edcdf4b84095 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:23.010362 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c12b020c-5ba7-4eaf-a901-edcdf4b84095 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:23.011467 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c12b020c-5ba7-4eaf-a901-edcdf4b84095 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1407 microversion: 2.20 time: 0.174243 Aug 31 09:56:23.012025 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 355/726] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:22 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:23.480718 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-91f128db-9a55-41f0-ab51-a0c8597a84b6 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:23.481618 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-91f128db-9a55-41f0-ab51-a0c8597a84b6 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:23.490702 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-91f128db-9a55-41f0-ab51-a0c8597a84b6 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:23.491532 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-91f128db-9a55-41f0-ab51-a0c8597a84b6 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:23.492192 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-91f128db-9a55-41f0-ab51-a0c8597a84b6 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:23.493092 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-91f128db-9a55-41f0-ab51-a0c8597a84b6 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:23.493868 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-91f128db-9a55-41f0-ab51-a0c8597a84b6 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:23.494424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-91f128db-9a55-41f0-ab51-a0c8597a84b6 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:23.576583 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-b5c7030c-eaba-41ce-9415-d5695783f00f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:23.577176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-b5c7030c-eaba-41ce-9415-d5695783f00f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:23.583824 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b5c7030c-eaba-41ce-9415-d5695783f00f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:23.584334 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b5c7030c-eaba-41ce-9415-d5695783f00f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:23.584767 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b5c7030c-eaba-41ce-9415-d5695783f00f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:23.585490 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b5c7030c-eaba-41ce-9415-d5695783f00f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:23.585941 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b5c7030c-eaba-41ce-9415-d5695783f00f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:23.586359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b5c7030c-eaba-41ce-9415-d5695783f00f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:23.642870 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-91f128db-9a55-41f0-ab51-a0c8597a84b6 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:23.650714 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-91f128db-9a55-41f0-ab51-a0c8597a84b6 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1566 microversion: 2.1 time: 0.176205 Aug 31 09:56:23.651291 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 372/727] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:23 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:23.655694 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-53e55a61-6d6a-427a-9a06-bc4382f5ac8e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:23.656296 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-53e55a61-6d6a-427a-9a06-bc4382f5ac8e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:23.663796 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-53e55a61-6d6a-427a-9a06-bc4382f5ac8e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:23.664290 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-53e55a61-6d6a-427a-9a06-bc4382f5ac8e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:23.664721 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-53e55a61-6d6a-427a-9a06-bc4382f5ac8e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:23.665637 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-53e55a61-6d6a-427a-9a06-bc4382f5ac8e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:23.666092 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-53e55a61-6d6a-427a-9a06-bc4382f5ac8e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:23.666514 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-53e55a61-6d6a-427a-9a06-bc4382f5ac8e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:23.734160 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-53e55a61-6d6a-427a-9a06-bc4382f5ac8e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:23.742735 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-53e55a61-6d6a-427a-9a06-bc4382f5ac8e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1135 microversion: 2.1 time: 0.090451 Aug 31 09:56:23.743633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 373/728] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:23 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1135 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:23.760472 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b5c7030c-eaba-41ce-9415-d5695783f00f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:23.769330 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-b5c7030c-eaba-41ce-9415-d5695783f00f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 200 len: 1362 microversion: 2.1 time: 0.196514 Aug 31 09:56:23.769924 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 356/729] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:23 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:24.034895 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-6ff349ec-1544-4482-8f53-44dd87abb3c5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:24.035415 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-6ff349ec-1544-4482-8f53-44dd87abb3c5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:24.041446 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ff349ec-1544-4482-8f53-44dd87abb3c5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:24.041930 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ff349ec-1544-4482-8f53-44dd87abb3c5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:24.042363 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ff349ec-1544-4482-8f53-44dd87abb3c5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:24.043047 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ff349ec-1544-4482-8f53-44dd87abb3c5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:24.043493 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ff349ec-1544-4482-8f53-44dd87abb3c5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:24.043913 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ff349ec-1544-4482-8f53-44dd87abb3c5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:24.179235 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-6ff349ec-1544-4482-8f53-44dd87abb3c5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:24.187375 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-6ff349ec-1544-4482-8f53-44dd87abb3c5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:24.188989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-6ff349ec-1544-4482-8f53-44dd87abb3c5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:24.190477 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-6ff349ec-1544-4482-8f53-44dd87abb3c5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1407 microversion: 2.20 time: 0.159539 Aug 31 09:56:24.190789 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 374/730] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:24 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:56:24.674464 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-864ca5c7-2e05-4bbb-ae4a-0c043b956711 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:24.674991 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-864ca5c7-2e05-4bbb-ae4a-0c043b956711 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:24.681456 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-864ca5c7-2e05-4bbb-ae4a-0c043b956711 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:24.682039 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-864ca5c7-2e05-4bbb-ae4a-0c043b956711 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:24.682370 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-864ca5c7-2e05-4bbb-ae4a-0c043b956711 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:24.683053 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-864ca5c7-2e05-4bbb-ae4a-0c043b956711 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:24.683523 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-864ca5c7-2e05-4bbb-ae4a-0c043b956711 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:24.683920 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-864ca5c7-2e05-4bbb-ae4a-0c043b956711 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:24.764814 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-fc06e981-e505-495f-ba46-0b815c9bc19f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:24.765217 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-fc06e981-e505-495f-ba46-0b815c9bc19f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:24.772098 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fc06e981-e505-495f-ba46-0b815c9bc19f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:24.772575 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fc06e981-e505-495f-ba46-0b815c9bc19f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:24.773003 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fc06e981-e505-495f-ba46-0b815c9bc19f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:24.773719 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fc06e981-e505-495f-ba46-0b815c9bc19f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:24.774177 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fc06e981-e505-495f-ba46-0b815c9bc19f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:24.774591 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fc06e981-e505-495f-ba46-0b815c9bc19f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:24.829736 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-864ca5c7-2e05-4bbb-ae4a-0c043b956711 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:24.837630 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-864ca5c7-2e05-4bbb-ae4a-0c043b956711 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1566 microversion: 2.1 time: 0.168164 Aug 31 09:56:24.846258 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 357/731] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:24 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:24.846258 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-f5e50f6c-cbd3-430f-a1c6-fe2b87b2d406 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:24.846258 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-f5e50f6c-cbd3-430f-a1c6-fe2b87b2d406 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:24.851102 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f5e50f6c-cbd3-430f-a1c6-fe2b87b2d406 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:24.851671 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f5e50f6c-cbd3-430f-a1c6-fe2b87b2d406 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:24.851981 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-fc06e981-e505-495f-ba46-0b815c9bc19f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:24.852118 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f5e50f6c-cbd3-430f-a1c6-fe2b87b2d406 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:24.852812 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f5e50f6c-cbd3-430f-a1c6-fe2b87b2d406 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:24.853266 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f5e50f6c-cbd3-430f-a1c6-fe2b87b2d406 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:24.853713 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f5e50f6c-cbd3-430f-a1c6-fe2b87b2d406 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:24.861306 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-fc06e981-e505-495f-ba46-0b815c9bc19f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1135 microversion: 2.1 time: 0.100796 Aug 31 09:56:24.861911 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 375/732] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:24 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1135 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:25.080331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-f5e50f6c-cbd3-430f-a1c6-fe2b87b2d406 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:25.089934 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-f5e50f6c-cbd3-430f-a1c6-fe2b87b2d406 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 200 len: 1362 microversion: 2.1 time: 0.250386 Aug 31 09:56:25.090536 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 358/733] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:24 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:25.215540 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-801d5434-93d5-4d43-aa01-b4d4a4345e4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:25.216125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-801d5434-93d5-4d43-aa01-b4d4a4345e4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:25.223489 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-801d5434-93d5-4d43-aa01-b4d4a4345e4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:25.224395 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-801d5434-93d5-4d43-aa01-b4d4a4345e4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:25.225003 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-801d5434-93d5-4d43-aa01-b4d4a4345e4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:25.225893 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-801d5434-93d5-4d43-aa01-b4d4a4345e4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:25.226525 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-801d5434-93d5-4d43-aa01-b4d4a4345e4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:25.227174 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-801d5434-93d5-4d43-aa01-b4d4a4345e4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:25.385175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-801d5434-93d5-4d43-aa01-b4d4a4345e4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:25.394210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-801d5434-93d5-4d43-aa01-b4d4a4345e4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:25.395661 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-801d5434-93d5-4d43-aa01-b4d4a4345e4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:25.396789 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-801d5434-93d5-4d43-aa01-b4d4a4345e4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1407 microversion: 2.20 time: 0.186338 Aug 31 09:56:25.397354 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 376/734] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:25 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:25.447640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-29b30421-6d98-49d0-bc3e-0539130b8e2b req-8e7a3be5-57ae-4dfa-8cbd-80a504fa481f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dad5a844-b1e2-4310-919c-7d3a334cc794", "name": "network-vif-plugged", "status": "completed", "tag": "faf14e51-3e45-4bef-906c-896093d3aeda"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:25.457914 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-29b30421-6d98-49d0-bc3e-0539130b8e2b req-8e7a3be5-57ae-4dfa-8cbd-80a504fa481f service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:25.458486 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-29b30421-6d98-49d0-bc3e-0539130b8e2b req-8e7a3be5-57ae-4dfa-8cbd-80a504fa481f service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:25.458982 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-29b30421-6d98-49d0-bc3e-0539130b8e2b req-8e7a3be5-57ae-4dfa-8cbd-80a504fa481f service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:25.470478 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-29b30421-6d98-49d0-bc3e-0539130b8e2b req-8e7a3be5-57ae-4dfa-8cbd-80a504fa481f service nova] Creating event network-vif-plugged:faf14e51-3e45-4bef-906c-896093d3aeda for instance dad5a844-b1e2-4310-919c-7d3a334cc794 on hv-cinder-84496 Aug 31 09:56:25.475522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-29b30421-6d98-49d0-bc3e-0539130b8e2b req-8e7a3be5-57ae-4dfa-8cbd-80a504fa481f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031555 Aug 31 09:56:25.476220 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 359/735] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:56:25.859516 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-2853688f-9394-425b-98f9-a88962ab56ac tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:25.860950 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-2853688f-9394-425b-98f9-a88962ab56ac tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:25.868424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2853688f-9394-425b-98f9-a88962ab56ac tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:25.869285 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2853688f-9394-425b-98f9-a88962ab56ac tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:25.869884 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2853688f-9394-425b-98f9-a88962ab56ac tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:25.870590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2853688f-9394-425b-98f9-a88962ab56ac tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:25.871050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2853688f-9394-425b-98f9-a88962ab56ac tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:25.871475 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2853688f-9394-425b-98f9-a88962ab56ac tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:25.884363 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-77f10d7c-dc00-4b59-b2b4-a33ad618049b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:25.885205 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-77f10d7c-dc00-4b59-b2b4-a33ad618049b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:25.892877 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-77f10d7c-dc00-4b59-b2b4-a33ad618049b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:25.893571 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-77f10d7c-dc00-4b59-b2b4-a33ad618049b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:25.894021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-77f10d7c-dc00-4b59-b2b4-a33ad618049b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:25.894722 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-77f10d7c-dc00-4b59-b2b4-a33ad618049b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:25.895215 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-77f10d7c-dc00-4b59-b2b4-a33ad618049b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:25.895786 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-77f10d7c-dc00-4b59-b2b4-a33ad618049b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:25.976024 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-77f10d7c-dc00-4b59-b2b4-a33ad618049b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:25.984077 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-77f10d7c-dc00-4b59-b2b4-a33ad618049b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1191 microversion: 2.1 time: 0.105376 Aug 31 09:56:25.985302 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 360/736] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:25 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1191 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:26.037473 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-2853688f-9394-425b-98f9-a88962ab56ac tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:26.045353 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-2853688f-9394-425b-98f9-a88962ab56ac tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1566 microversion: 2.1 time: 0.189756 Aug 31 09:56:26.045942 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 377/737] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:25 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1566 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:26.112377 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-1afa0520-3c84-42e0-9b1a-ca0f05ee9731 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:26.112982 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-1afa0520-3c84-42e0-9b1a-ca0f05ee9731 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:26.119686 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1afa0520-3c84-42e0-9b1a-ca0f05ee9731 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:26.120279 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1afa0520-3c84-42e0-9b1a-ca0f05ee9731 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:26.120707 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1afa0520-3c84-42e0-9b1a-ca0f05ee9731 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:26.121413 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1afa0520-3c84-42e0-9b1a-ca0f05ee9731 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:26.121862 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1afa0520-3c84-42e0-9b1a-ca0f05ee9731 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:26.122304 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1afa0520-3c84-42e0-9b1a-ca0f05ee9731 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:26.251515 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-1afa0520-3c84-42e0-9b1a-ca0f05ee9731 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:26.259418 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-1afa0520-3c84-42e0-9b1a-ca0f05ee9731 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 200 len: 1362 microversion: 2.1 time: 0.151651 Aug 31 09:56:26.259982 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 361/738] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:26 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:26.419718 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-9133e051-f3a1-409e-89f4-9d92c684f4cf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:26.420319 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-9133e051-f3a1-409e-89f4-9d92c684f4cf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:26.426862 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9133e051-f3a1-409e-89f4-9d92c684f4cf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:26.427338 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9133e051-f3a1-409e-89f4-9d92c684f4cf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:26.427762 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9133e051-f3a1-409e-89f4-9d92c684f4cf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:26.428435 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9133e051-f3a1-409e-89f4-9d92c684f4cf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:26.428882 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9133e051-f3a1-409e-89f4-9d92c684f4cf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:26.429294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9133e051-f3a1-409e-89f4-9d92c684f4cf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:26.564876 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-9133e051-f3a1-409e-89f4-9d92c684f4cf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:26.573071 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-9133e051-f3a1-409e-89f4-9d92c684f4cf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:26.574525 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-9133e051-f3a1-409e-89f4-9d92c684f4cf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:26.575609 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-9133e051-f3a1-409e-89f4-9d92c684f4cf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1407 microversion: 2.20 time: 0.159912 Aug 31 09:56:26.576156 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 378/739] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:26 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:27.008209 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-60b07c61-869a-4676-bca3-88caef9d5ee1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:27.008879 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-60b07c61-869a-4676-bca3-88caef9d5ee1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:27.016933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-60b07c61-869a-4676-bca3-88caef9d5ee1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:27.017443 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-60b07c61-869a-4676-bca3-88caef9d5ee1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:27.018074 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-60b07c61-869a-4676-bca3-88caef9d5ee1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:27.018780 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-60b07c61-869a-4676-bca3-88caef9d5ee1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:27.019219 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-60b07c61-869a-4676-bca3-88caef9d5ee1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:27.019823 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-60b07c61-869a-4676-bca3-88caef9d5ee1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:27.066841 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b1b9584e-5f7c-42bf-9d38-feec14c80d36 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:27.067378 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b1b9584e-5f7c-42bf-9d38-feec14c80d36 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:27.074174 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b1b9584e-5f7c-42bf-9d38-feec14c80d36 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:27.074953 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b1b9584e-5f7c-42bf-9d38-feec14c80d36 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:27.075380 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b1b9584e-5f7c-42bf-9d38-feec14c80d36 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:27.076076 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b1b9584e-5f7c-42bf-9d38-feec14c80d36 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:27.076521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b1b9584e-5f7c-42bf-9d38-feec14c80d36 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:27.076939 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b1b9584e-5f7c-42bf-9d38-feec14c80d36 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:27.095469 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-60b07c61-869a-4676-bca3-88caef9d5ee1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:27.105639 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-60b07c61-869a-4676-bca3-88caef9d5ee1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1199 microversion: 2.1 time: 0.102136 Aug 31 09:56:27.106442 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 362/740] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:27 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1199 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:27.285112 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-bb6421c9-5207-4d42-bb33-1068b6ce70aa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:27.285935 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-bb6421c9-5207-4d42-bb33-1068b6ce70aa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:27.292983 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-bb6421c9-5207-4d42-bb33-1068b6ce70aa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:27.293837 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-bb6421c9-5207-4d42-bb33-1068b6ce70aa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:27.294927 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-bb6421c9-5207-4d42-bb33-1068b6ce70aa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:27.296104 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-bb6421c9-5207-4d42-bb33-1068b6ce70aa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:27.296818 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-bb6421c9-5207-4d42-bb33-1068b6ce70aa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:27.297995 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-bb6421c9-5207-4d42-bb33-1068b6ce70aa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:27.298546 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b1b9584e-5f7c-42bf-9d38-feec14c80d36 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:27.306614 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b1b9584e-5f7c-42bf-9d38-feec14c80d36 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1566 microversion: 2.1 time: 0.243711 Aug 31 09:56:27.320306 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 379/741] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:27 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1566 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:27.495246 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-a4f01dc1-0271-4358-8d2c-c6705aba3c55 req-4e064473-2115-4f8c-82f5-c0ac6cfb34b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9", "name": "network-vif-plugged", "status": "completed", "tag": "f0ab5d21-97ec-4a21-a75b-253b40f65e47"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:27.505308 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-a4f01dc1-0271-4358-8d2c-c6705aba3c55 req-4e064473-2115-4f8c-82f5-c0ac6cfb34b6 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:27.505915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-a4f01dc1-0271-4358-8d2c-c6705aba3c55 req-4e064473-2115-4f8c-82f5-c0ac6cfb34b6 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:27.506406 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-a4f01dc1-0271-4358-8d2c-c6705aba3c55 req-4e064473-2115-4f8c-82f5-c0ac6cfb34b6 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:27.518783 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-a4f01dc1-0271-4358-8d2c-c6705aba3c55 req-4e064473-2115-4f8c-82f5-c0ac6cfb34b6 service nova] Creating event network-vif-plugged:f0ab5d21-97ec-4a21-a75b-253b40f65e47 for instance b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 on hv-cinder-84496 Aug 31 09:56:27.524946 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-a4f01dc1-0271-4358-8d2c-c6705aba3c55 req-4e064473-2115-4f8c-82f5-c0ac6cfb34b6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035313 Aug 31 09:56:27.526028 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 380/742] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:56:27.584814 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-bb6421c9-5207-4d42-bb33-1068b6ce70aa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:27.594815 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-bb6421c9-5207-4d42-bb33-1068b6ce70aa tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 200 len: 1362 microversion: 2.1 time: 0.316809 Aug 31 09:56:27.596290 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 363/743] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:27 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 1362 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:27.599257 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a061c4ef-a03a-45ae-b9ed-faea13a7abfa tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:27.600236 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-a061c4ef-a03a-45ae-b9ed-faea13a7abfa tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:27.607250 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a061c4ef-a03a-45ae-b9ed-faea13a7abfa tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:27.607988 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a061c4ef-a03a-45ae-b9ed-faea13a7abfa tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:27.608575 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a061c4ef-a03a-45ae-b9ed-faea13a7abfa tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:27.609275 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a061c4ef-a03a-45ae-b9ed-faea13a7abfa tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:27.610831 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a061c4ef-a03a-45ae-b9ed-faea13a7abfa tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:27.611465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a061c4ef-a03a-45ae-b9ed-faea13a7abfa tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:27.633689 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=100 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:27.852886 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-a061c4ef-a03a-45ae-b9ed-faea13a7abfa tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:27.864280 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-a061c4ef-a03a-45ae-b9ed-faea13a7abfa tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:27.866768 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-a061c4ef-a03a-45ae-b9ed-faea13a7abfa tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:27.868435 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a061c4ef-a03a-45ae-b9ed-faea13a7abfa tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1407 microversion: 2.20 time: 0.274829 Aug 31 09:56:27.869454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 381/744] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:27 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:56:28.132380 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-af420264-3027-4224-82df-7615d3d2aa06 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:28.134274 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-af420264-3027-4224-82df-7615d3d2aa06 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:28.155183 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-af420264-3027-4224-82df-7615d3d2aa06 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:28.156053 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-af420264-3027-4224-82df-7615d3d2aa06 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:28.158118 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-af420264-3027-4224-82df-7615d3d2aa06 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:28.159276 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-af420264-3027-4224-82df-7615d3d2aa06 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:28.160178 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-af420264-3027-4224-82df-7615d3d2aa06 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:28.160945 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-af420264-3027-4224-82df-7615d3d2aa06 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:28.199889 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=100 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:28.327443 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-82656ce6-f483-4cae-957f-2252d24b8bce tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:28.328192 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-82656ce6-f483-4cae-957f-2252d24b8bce tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:28.336057 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-82656ce6-f483-4cae-957f-2252d24b8bce tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:28.336672 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-82656ce6-f483-4cae-957f-2252d24b8bce tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:28.337238 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-82656ce6-f483-4cae-957f-2252d24b8bce tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:28.338062 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-82656ce6-f483-4cae-957f-2252d24b8bce tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:28.338618 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-82656ce6-f483-4cae-957f-2252d24b8bce tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:28.339134 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-82656ce6-f483-4cae-957f-2252d24b8bce tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:28.431712 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-af420264-3027-4224-82df-7615d3d2aa06 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:28.444626 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-af420264-3027-4224-82df-7615d3d2aa06 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1277 microversion: 2.1 time: 0.319593 Aug 31 09:56:28.448819 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 364/745] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:28 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1277 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:28.614870 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-82656ce6-f483-4cae-957f-2252d24b8bce tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:28.618846 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-a982b25e-61a8-4c1b-8422-affb9044ba3f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:28.619753 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-a982b25e-61a8-4c1b-8422-affb9044ba3f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:28.632508 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-82656ce6-f483-4cae-957f-2252d24b8bce tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1566 microversion: 2.1 time: 0.309288 Aug 31 09:56:28.633563 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 382/746] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:28 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1566 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:28.636733 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a982b25e-61a8-4c1b-8422-affb9044ba3f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:28.637533 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a982b25e-61a8-4c1b-8422-affb9044ba3f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:28.638398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a982b25e-61a8-4c1b-8422-affb9044ba3f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:28.639284 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a982b25e-61a8-4c1b-8422-affb9044ba3f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:28.639894 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a982b25e-61a8-4c1b-8422-affb9044ba3f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:28.640466 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a982b25e-61a8-4c1b-8422-affb9044ba3f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:28.891983 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-76cdc0c7-7785-425b-a194-f8a882750a3d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:28.894424 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-a982b25e-61a8-4c1b-8422-affb9044ba3f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:28.894709 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-76cdc0c7-7785-425b-a194-f8a882750a3d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:28.901414 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-76cdc0c7-7785-425b-a194-f8a882750a3d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:28.902186 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-76cdc0c7-7785-425b-a194-f8a882750a3d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:28.902796 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-76cdc0c7-7785-425b-a194-f8a882750a3d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:28.903505 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-76cdc0c7-7785-425b-a194-f8a882750a3d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:28.903940 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-76cdc0c7-7785-425b-a194-f8a882750a3d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:28.904366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-76cdc0c7-7785-425b-a194-f8a882750a3d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:28.911226 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-a982b25e-61a8-4c1b-8422-affb9044ba3f tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 200 len: 1362 microversion: 2.1 time: 0.297263 Aug 31 09:56:28.925830 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 365/747] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:28 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:29.178473 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-76cdc0c7-7785-425b-a194-f8a882750a3d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:29.187056 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-76cdc0c7-7785-425b-a194-f8a882750a3d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:29.188792 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-76cdc0c7-7785-425b-a194-f8a882750a3d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:29.189980 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-76cdc0c7-7785-425b-a194-f8a882750a3d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1407 microversion: 2.20 time: 0.302458 Aug 31 09:56:29.190644 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 383/748] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:28 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:29.331584 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-ce938985-abf4-4d84-bb9e-2f153ffd483f req-f9f82408-f6bf-40fc-8eb2-811bd0ac1db4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "482325e0-2a4b-4446-804a-0e3a1bcb722c", "tag": "6937ee29-5c42-40ef-97b4-9409defc0131"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:29.342598 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-ce938985-abf4-4d84-bb9e-2f153ffd483f req-f9f82408-f6bf-40fc-8eb2-811bd0ac1db4 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:29.343072 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-ce938985-abf4-4d84-bb9e-2f153ffd483f req-f9f82408-f6bf-40fc-8eb2-811bd0ac1db4 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:29.343492 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-ce938985-abf4-4d84-bb9e-2f153ffd483f req-f9f82408-f6bf-40fc-8eb2-811bd0ac1db4 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:29.357656 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-ce938985-abf4-4d84-bb9e-2f153ffd483f req-f9f82408-f6bf-40fc-8eb2-811bd0ac1db4 service nova] Creating event network-changed:6937ee29-5c42-40ef-97b4-9409defc0131 for instance 482325e0-2a4b-4446-804a-0e3a1bcb722c on hv-cinder-84496 Aug 31 09:56:29.363284 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-ce938985-abf4-4d84-bb9e-2f153ffd483f req-f9f82408-f6bf-40fc-8eb2-811bd0ac1db4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035907 Aug 31 09:56:29.363900 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 366/749] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:56:29.467890 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-e6e8fcc1-0a8a-4a70-95e8-e609ee4a8bb1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:29.468501 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-e6e8fcc1-0a8a-4a70-95e8-e609ee4a8bb1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:29.477351 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e6e8fcc1-0a8a-4a70-95e8-e609ee4a8bb1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:29.477902 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e6e8fcc1-0a8a-4a70-95e8-e609ee4a8bb1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:29.478340 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e6e8fcc1-0a8a-4a70-95e8-e609ee4a8bb1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:29.479066 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e6e8fcc1-0a8a-4a70-95e8-e609ee4a8bb1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:29.479516 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e6e8fcc1-0a8a-4a70-95e8-e609ee4a8bb1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:29.479939 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e6e8fcc1-0a8a-4a70-95e8-e609ee4a8bb1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:29.540331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-af6841b9-1f58-4c35-996d-972bd7a27d34 req-de31226f-d491-4e2b-8907-a2a3dcac7679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b32c74c-ed7a-496f-bf84-ce2d50e8b808", "name": "network-vif-unplugged", "status": "completed", "tag": "a4adc3c8-d787-4f05-8cd2-ace7305b75c0"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:29.551480 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-af6841b9-1f58-4c35-996d-972bd7a27d34 req-de31226f-d491-4e2b-8907-a2a3dcac7679 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:29.551954 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-af6841b9-1f58-4c35-996d-972bd7a27d34 req-de31226f-d491-4e2b-8907-a2a3dcac7679 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:29.552382 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-af6841b9-1f58-4c35-996d-972bd7a27d34 req-de31226f-d491-4e2b-8907-a2a3dcac7679 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:29.565030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-af6841b9-1f58-4c35-996d-972bd7a27d34 req-de31226f-d491-4e2b-8907-a2a3dcac7679 service nova] Creating event network-vif-unplugged:a4adc3c8-d787-4f05-8cd2-ace7305b75c0 for instance 1b32c74c-ed7a-496f-bf84-ce2d50e8b808 on hv-cinder-84496 Aug 31 09:56:29.572383 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-af6841b9-1f58-4c35-996d-972bd7a27d34 req-de31226f-d491-4e2b-8907-a2a3dcac7679 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036022 Aug 31 09:56:29.573000 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 367/750] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:56:29.631466 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-e6e8fcc1-0a8a-4a70-95e8-e609ee4a8bb1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:29.639762 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-e6e8fcc1-0a8a-4a70-95e8-e609ee4a8bb1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1265 microversion: 2.1 time: 0.176279 Aug 31 09:56:29.640339 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 384/751] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:29 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:29.655768 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-b02e44ca-67e0-4e43-9682-aa6024c43e11 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:29.656491 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-b02e44ca-67e0-4e43-9682-aa6024c43e11 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:29.662974 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b02e44ca-67e0-4e43-9682-aa6024c43e11 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:29.663450 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b02e44ca-67e0-4e43-9682-aa6024c43e11 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:29.663888 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b02e44ca-67e0-4e43-9682-aa6024c43e11 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:29.664572 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b02e44ca-67e0-4e43-9682-aa6024c43e11 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:29.665016 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b02e44ca-67e0-4e43-9682-aa6024c43e11 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:29.665453 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b02e44ca-67e0-4e43-9682-aa6024c43e11 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:29.811766 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b02e44ca-67e0-4e43-9682-aa6024c43e11 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:29.820953 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-b02e44ca-67e0-4e43-9682-aa6024c43e11 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1567 microversion: 2.1 time: 0.169357 Aug 31 09:56:29.821555 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 368/752] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:29 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:29.932546 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-364a087a-5388-424b-9450-62130c5849a4 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:29.933154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-364a087a-5388-424b-9450-62130c5849a4 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:29.942094 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-364a087a-5388-424b-9450-62130c5849a4 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:29.947488 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-364a087a-5388-424b-9450-62130c5849a4 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:29.947651 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-139f73a0-4de1-4afc-ad9b-744ee49fd577 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:29.947968 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-364a087a-5388-424b-9450-62130c5849a4 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:29.948092 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-139f73a0-4de1-4afc-ad9b-744ee49fd577 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:29.948843 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-364a087a-5388-424b-9450-62130c5849a4 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:29.949314 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-364a087a-5388-424b-9450-62130c5849a4 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:29.949777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-364a087a-5388-424b-9450-62130c5849a4 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:29.955067 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-139f73a0-4de1-4afc-ad9b-744ee49fd577 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:29.955595 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-139f73a0-4de1-4afc-ad9b-744ee49fd577 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:29.956129 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-139f73a0-4de1-4afc-ad9b-744ee49fd577 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:29.958296 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-139f73a0-4de1-4afc-ad9b-744ee49fd577 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:29.958750 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-139f73a0-4de1-4afc-ad9b-744ee49fd577 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:29.959166 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-139f73a0-4de1-4afc-ad9b-744ee49fd577 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:30.011913 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-139f73a0-4de1-4afc-ad9b-744ee49fd577 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127170) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 09:56:30.082156 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-139f73a0-4de1-4afc-ad9b-744ee49fd577 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "POST /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808/action" status: 202 len: 0 microversion: 2.1 time: 0.243124 Aug 31 09:56:30.082752 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 385/753] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 31 09:56:29 2022] POST /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 09:56:30.086056 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=4 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:30.091361 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-c5ed4b05-5861-47eb-9fee-f7dbcd56fb93 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:30.091975 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-c5ed4b05-5861-47eb-9fee-f7dbcd56fb93 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:30.098456 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-364a087a-5388-424b-9450-62130c5849a4 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:30.099058 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c5ed4b05-5861-47eb-9fee-f7dbcd56fb93 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:30.099544 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c5ed4b05-5861-47eb-9fee-f7dbcd56fb93 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:30.100092 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c5ed4b05-5861-47eb-9fee-f7dbcd56fb93 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:30.101536 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c5ed4b05-5861-47eb-9fee-f7dbcd56fb93 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:30.101536 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c5ed4b05-5861-47eb-9fee-f7dbcd56fb93 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:30.102253 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c5ed4b05-5861-47eb-9fee-f7dbcd56fb93 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:30.108374 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-364a087a-5388-424b-9450-62130c5849a4 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 200 len: 1548 microversion: 2.1 time: 0.179690 Aug 31 09:56:30.108951 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 369/754] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:29 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 1548 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:30.130804 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-ee6f0068-023b-4090-a4a7-5a2c5f32bf62 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:30.131722 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-ee6f0068-023b-4090-a4a7-5a2c5f32bf62 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:30.136827 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=20 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:30.138593 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ee6f0068-023b-4090-a4a7-5a2c5f32bf62 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:30.139072 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ee6f0068-023b-4090-a4a7-5a2c5f32bf62 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:30.139740 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ee6f0068-023b-4090-a4a7-5a2c5f32bf62 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:30.140447 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ee6f0068-023b-4090-a4a7-5a2c5f32bf62 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:30.141665 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ee6f0068-023b-4090-a4a7-5a2c5f32bf62 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:30.142346 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ee6f0068-023b-4090-a4a7-5a2c5f32bf62 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:30.259274 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-ee6f0068-023b-4090-a4a7-5a2c5f32bf62 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132444 Aug 31 09:56:30.267953 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 370/755] 10.222.0.13 () {58 vars in 1275 bytes} [Wed Aug 31 09:56:30 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:56:30.274763 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-4232851a-b244-400e-8a19-5cd4d865a07f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:30.275685 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-4232851a-b244-400e-8a19-5cd4d865a07f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:30.283075 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4232851a-b244-400e-8a19-5cd4d865a07f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:30.283644 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4232851a-b244-400e-8a19-5cd4d865a07f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:30.284424 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4232851a-b244-400e-8a19-5cd4d865a07f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:30.285012 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4232851a-b244-400e-8a19-5cd4d865a07f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:30.285582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4232851a-b244-400e-8a19-5cd4d865a07f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:30.286671 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4232851a-b244-400e-8a19-5cd4d865a07f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:30.295915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-c5ed4b05-5861-47eb-9fee-f7dbcd56fb93 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:30.306163 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-c5ed4b05-5861-47eb-9fee-f7dbcd56fb93 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1575 microversion: 2.1 time: 0.219061 Aug 31 09:56:30.306837 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 386/756] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:30 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1575 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:30.665856 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=18 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:30.753250 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-4232851a-b244-400e-8a19-5cd4d865a07f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:30.761795 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-91450e1f-9c3f-4c19-8115-5f965682e5bc tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:30.763635 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-91450e1f-9c3f-4c19-8115-5f965682e5bc tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:30.781760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-4232851a-b244-400e-8a19-5cd4d865a07f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:30.787610 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-4232851a-b244-400e-8a19-5cd4d865a07f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:30.788823 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-91450e1f-9c3f-4c19-8115-5f965682e5bc tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:30.789114 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-91450e1f-9c3f-4c19-8115-5f965682e5bc tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:30.790527 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-4232851a-b244-400e-8a19-5cd4d865a07f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1407 microversion: 2.20 time: 0.529295 Aug 31 09:56:30.791188 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-91450e1f-9c3f-4c19-8115-5f965682e5bc tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:30.792091 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 371/757] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:30 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1407 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:30.792573 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-91450e1f-9c3f-4c19-8115-5f965682e5bc tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:30.793106 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-91450e1f-9c3f-4c19-8115-5f965682e5bc tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:30.793680 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-91450e1f-9c3f-4c19-8115-5f965682e5bc tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:31.325966 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-91450e1f-9c3f-4c19-8115-5f965682e5bc tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:31.333844 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-7121d4b3-0d10-4b43-ac75-f842fc592896 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:31.334762 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-7121d4b3-0d10-4b43-ac75-f842fc592896 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:31.335162 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-91450e1f-9c3f-4c19-8115-5f965682e5bc tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1265 microversion: 2.1 time: 0.676824 Aug 31 09:56:31.349420 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 387/758] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:30 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1265 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:31.349640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7121d4b3-0d10-4b43-ac75-f842fc592896 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:31.349640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7121d4b3-0d10-4b43-ac75-f842fc592896 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:31.349640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7121d4b3-0d10-4b43-ac75-f842fc592896 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:31.349640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7121d4b3-0d10-4b43-ac75-f842fc592896 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:31.349997 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7121d4b3-0d10-4b43-ac75-f842fc592896 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:31.349997 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7121d4b3-0d10-4b43-ac75-f842fc592896 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:31.624189 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7121d4b3-0d10-4b43-ac75-f842fc592896 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:31.640825 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-7121d4b3-0d10-4b43-ac75-f842fc592896 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1515 microversion: 2.1 time: 0.314341 Aug 31 09:56:31.641978 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 372/759] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:31 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1515 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:31.817057 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-cbebc23d-423d-4393-bb10-34682a048ec2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:31.818232 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-cbebc23d-423d-4393-bb10-34682a048ec2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:31.829892 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cbebc23d-423d-4393-bb10-34682a048ec2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:31.830495 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cbebc23d-423d-4393-bb10-34682a048ec2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:31.831314 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cbebc23d-423d-4393-bb10-34682a048ec2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:31.832982 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cbebc23d-423d-4393-bb10-34682a048ec2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:31.834531 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cbebc23d-423d-4393-bb10-34682a048ec2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:31.835465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cbebc23d-423d-4393-bb10-34682a048ec2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:32.197747 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-cbebc23d-423d-4393-bb10-34682a048ec2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:32.210671 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-cbebc23d-423d-4393-bb10-34682a048ec2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:32.212484 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-cbebc23d-423d-4393-bb10-34682a048ec2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:32.214092 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-cbebc23d-423d-4393-bb10-34682a048ec2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1600 microversion: 2.20 time: 0.401634 Aug 31 09:56:32.214927 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 388/760] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:31 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1600 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:32.243782 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-0903f795-546d-4d56-8e14-1779dea80e01 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:32.244374 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-0903f795-546d-4d56-8e14-1779dea80e01 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:32.251832 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0903f795-546d-4d56-8e14-1779dea80e01 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:32.252342 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0903f795-546d-4d56-8e14-1779dea80e01 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:32.253185 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0903f795-546d-4d56-8e14-1779dea80e01 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:32.254556 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0903f795-546d-4d56-8e14-1779dea80e01 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:32.254556 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0903f795-546d-4d56-8e14-1779dea80e01 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:32.255107 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0903f795-546d-4d56-8e14-1779dea80e01 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:32.333917 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-d569995a-0c81-4bfb-b200-720e3742ed96 req-a4b921fe-63b5-4270-b2f8-11aa774cf6c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dad5a844-b1e2-4310-919c-7d3a334cc794", "tag": "faf14e51-3e45-4bef-906c-896093d3aeda"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:32.351125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-d569995a-0c81-4bfb-b200-720e3742ed96 req-a4b921fe-63b5-4270-b2f8-11aa774cf6c9 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:32.352362 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-d569995a-0c81-4bfb-b200-720e3742ed96 req-a4b921fe-63b5-4270-b2f8-11aa774cf6c9 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:32.353187 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-d569995a-0c81-4bfb-b200-720e3742ed96 req-a4b921fe-63b5-4270-b2f8-11aa774cf6c9 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:32.369066 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-d569995a-0c81-4bfb-b200-720e3742ed96 req-a4b921fe-63b5-4270-b2f8-11aa774cf6c9 service nova] Creating event network-changed:faf14e51-3e45-4bef-906c-896093d3aeda for instance dad5a844-b1e2-4310-919c-7d3a334cc794 on hv-cinder-84496 Aug 31 09:56:32.376532 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-d569995a-0c81-4bfb-b200-720e3742ed96 req-a4b921fe-63b5-4270-b2f8-11aa774cf6c9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051910 Aug 31 09:56:32.377910 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 389/761] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:56:32.383615 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-d8560e06-34ce-434e-8e9f-edbefa6f09d7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:32.384995 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-d8560e06-34ce-434e-8e9f-edbefa6f09d7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:32.400168 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d8560e06-34ce-434e-8e9f-edbefa6f09d7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:32.402278 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d8560e06-34ce-434e-8e9f-edbefa6f09d7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:32.403093 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d8560e06-34ce-434e-8e9f-edbefa6f09d7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:32.404460 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d8560e06-34ce-434e-8e9f-edbefa6f09d7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:32.407895 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d8560e06-34ce-434e-8e9f-edbefa6f09d7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:32.408873 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d8560e06-34ce-434e-8e9f-edbefa6f09d7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:32.429878 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-0903f795-546d-4d56-8e14-1779dea80e01 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.190201 Aug 31 09:56:32.431369 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 373/762] 10.222.0.13 () {60 vars in 1316 bytes} [Wed Aug 31 09:56:32 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9/os-interface => generated 285 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:56:32.668111 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-6545cb6a-81c5-44c0-8d78-52f080b60e3e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:32.669163 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-6545cb6a-81c5-44c0-8d78-52f080b60e3e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:32.679032 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6545cb6a-81c5-44c0-8d78-52f080b60e3e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:32.679791 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6545cb6a-81c5-44c0-8d78-52f080b60e3e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:32.680493 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6545cb6a-81c5-44c0-8d78-52f080b60e3e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:32.681815 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6545cb6a-81c5-44c0-8d78-52f080b60e3e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:32.682509 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6545cb6a-81c5-44c0-8d78-52f080b60e3e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:32.683204 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6545cb6a-81c5-44c0-8d78-52f080b60e3e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:32.807819 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-d8560e06-34ce-434e-8e9f-edbefa6f09d7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:32.818476 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-d8560e06-34ce-434e-8e9f-edbefa6f09d7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1265 microversion: 2.1 time: 0.439101 Aug 31 09:56:32.819869 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 390/763] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:32 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1265 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:32.967374 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-6545cb6a-81c5-44c0-8d78-52f080b60e3e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:32.980141 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-6545cb6a-81c5-44c0-8d78-52f080b60e3e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1517 microversion: 2.1 time: 0.316271 Aug 31 09:56:32.981231 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 374/764] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:32 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1517 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:33.788037 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-045e471b-827c-4cda-bead-fb3f2ebac0dc req-5eb9f5c5-47dd-4e5f-8e2e-d909d7aa6cab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9", "tag": "f0ab5d21-97ec-4a21-a75b-253b40f65e47"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:33.799156 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-045e471b-827c-4cda-bead-fb3f2ebac0dc req-5eb9f5c5-47dd-4e5f-8e2e-d909d7aa6cab service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:33.799631 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-045e471b-827c-4cda-bead-fb3f2ebac0dc req-5eb9f5c5-47dd-4e5f-8e2e-d909d7aa6cab service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:33.800041 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-045e471b-827c-4cda-bead-fb3f2ebac0dc req-5eb9f5c5-47dd-4e5f-8e2e-d909d7aa6cab service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:33.815765 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-045e471b-827c-4cda-bead-fb3f2ebac0dc req-5eb9f5c5-47dd-4e5f-8e2e-d909d7aa6cab service nova] Creating event network-changed:f0ab5d21-97ec-4a21-a75b-253b40f65e47 for instance b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 on hv-cinder-84496 Aug 31 09:56:33.821194 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-045e471b-827c-4cda-bead-fb3f2ebac0dc req-5eb9f5c5-47dd-4e5f-8e2e-d909d7aa6cab service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037082 Aug 31 09:56:33.822455 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 391/765] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:56:33.848590 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-3d574686-deec-4e56-bb3a-dcf9b20fa347 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:33.849336 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-3d574686-deec-4e56-bb3a-dcf9b20fa347 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:33.857342 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3d574686-deec-4e56-bb3a-dcf9b20fa347 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:33.858014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3d574686-deec-4e56-bb3a-dcf9b20fa347 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:33.858521 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3d574686-deec-4e56-bb3a-dcf9b20fa347 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:33.859393 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3d574686-deec-4e56-bb3a-dcf9b20fa347 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:33.859930 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3d574686-deec-4e56-bb3a-dcf9b20fa347 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:33.860361 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3d574686-deec-4e56-bb3a-dcf9b20fa347 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:34.005473 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b0739d3e-d341-4e85-ad4f-5fabd3c99fca tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:34.006547 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b0739d3e-d341-4e85-ad4f-5fabd3c99fca tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:34.013172 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b0739d3e-d341-4e85-ad4f-5fabd3c99fca tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:34.013805 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b0739d3e-d341-4e85-ad4f-5fabd3c99fca tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:34.014296 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b0739d3e-d341-4e85-ad4f-5fabd3c99fca tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:34.015083 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b0739d3e-d341-4e85-ad4f-5fabd3c99fca tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:34.016410 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b0739d3e-d341-4e85-ad4f-5fabd3c99fca tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:34.016849 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b0739d3e-d341-4e85-ad4f-5fabd3c99fca tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:34.064579 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-3d574686-deec-4e56-bb3a-dcf9b20fa347 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:34.075992 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-3d574686-deec-4e56-bb3a-dcf9b20fa347 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1265 microversion: 2.1 time: 0.236760 Aug 31 09:56:34.077194 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 375/766] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:33 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:34.405719 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b0739d3e-d341-4e85-ad4f-5fabd3c99fca tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:34.418633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b0739d3e-d341-4e85-ad4f-5fabd3c99fca tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1573 microversion: 2.1 time: 0.418080 Aug 31 09:56:34.419640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 392/767] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:33 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1573 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:35.104426 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-eaefbfd9-80a8-4ccb-b229-405fc77e1ac9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:35.106056 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-eaefbfd9-80a8-4ccb-b229-405fc77e1ac9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:35.114006 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-eaefbfd9-80a8-4ccb-b229-405fc77e1ac9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:35.114510 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-eaefbfd9-80a8-4ccb-b229-405fc77e1ac9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:35.114958 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-eaefbfd9-80a8-4ccb-b229-405fc77e1ac9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:35.116142 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-eaefbfd9-80a8-4ccb-b229-405fc77e1ac9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:35.116612 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-eaefbfd9-80a8-4ccb-b229-405fc77e1ac9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:35.117044 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-eaefbfd9-80a8-4ccb-b229-405fc77e1ac9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:35.448230 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-44cee48b-211e-425b-b0fa-804de21657a1 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:35.449512 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-44cee48b-211e-425b-b0fa-804de21657a1 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:35.456460 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-eaefbfd9-80a8-4ccb-b229-405fc77e1ac9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:35.463839 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-44cee48b-211e-425b-b0fa-804de21657a1 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:35.464533 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-44cee48b-211e-425b-b0fa-804de21657a1 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:35.465133 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-44cee48b-211e-425b-b0fa-804de21657a1 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:35.466113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-44cee48b-211e-425b-b0fa-804de21657a1 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:35.466741 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-44cee48b-211e-425b-b0fa-804de21657a1 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:35.467340 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-44cee48b-211e-425b-b0fa-804de21657a1 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:35.472329 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-eaefbfd9-80a8-4ccb-b229-405fc77e1ac9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1265 microversion: 2.1 time: 0.371384 Aug 31 09:56:35.473444 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 376/768] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:35 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1265 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:35.987776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-44cee48b-211e-425b-b0fa-804de21657a1 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:35.999108 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-44cee48b-211e-425b-b0fa-804de21657a1 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1573 microversion: 2.1 time: 0.554522 Aug 31 09:56:36.000876 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 393/769] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:35 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1573 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:36.495155 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-de7470bf-f5e8-4b89-adda-764b50494ebb tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:36.495901 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-de7470bf-f5e8-4b89-adda-764b50494ebb tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:36.503600 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-de7470bf-f5e8-4b89-adda-764b50494ebb tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:36.504144 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-de7470bf-f5e8-4b89-adda-764b50494ebb tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:36.504619 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-de7470bf-f5e8-4b89-adda-764b50494ebb tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:36.505491 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-de7470bf-f5e8-4b89-adda-764b50494ebb tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:36.506002 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-de7470bf-f5e8-4b89-adda-764b50494ebb tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:36.506602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-de7470bf-f5e8-4b89-adda-764b50494ebb tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:36.669184 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-de7470bf-f5e8-4b89-adda-764b50494ebb tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:36.677692 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-de7470bf-f5e8-4b89-adda-764b50494ebb tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1265 microversion: 2.1 time: 0.186426 Aug 31 09:56:36.678339 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 377/770] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:36 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:37.022964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-ba88c1ff-ba7b-431c-a2bb-c8eccd995f2b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:37.023630 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-ba88c1ff-ba7b-431c-a2bb-c8eccd995f2b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:37.030317 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ba88c1ff-ba7b-431c-a2bb-c8eccd995f2b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:37.030796 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ba88c1ff-ba7b-431c-a2bb-c8eccd995f2b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:37.031264 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ba88c1ff-ba7b-431c-a2bb-c8eccd995f2b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:37.032113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ba88c1ff-ba7b-431c-a2bb-c8eccd995f2b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:37.032573 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ba88c1ff-ba7b-431c-a2bb-c8eccd995f2b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:37.033072 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ba88c1ff-ba7b-431c-a2bb-c8eccd995f2b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:37.182671 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-ba88c1ff-ba7b-431c-a2bb-c8eccd995f2b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:37.191633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-ba88c1ff-ba7b-431c-a2bb-c8eccd995f2b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1573 microversion: 2.1 time: 0.172466 Aug 31 09:56:37.192229 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 394/771] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:37 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1573 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:37.700736 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-32991751-6faf-4994-aee0-746bdbb2c849 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:37.701356 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-32991751-6faf-4994-aee0-746bdbb2c849 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:37.708753 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-32991751-6faf-4994-aee0-746bdbb2c849 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:37.709275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-32991751-6faf-4994-aee0-746bdbb2c849 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:37.709738 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-32991751-6faf-4994-aee0-746bdbb2c849 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:37.710479 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-32991751-6faf-4994-aee0-746bdbb2c849 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:37.710928 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-32991751-6faf-4994-aee0-746bdbb2c849 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:37.711345 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-32991751-6faf-4994-aee0-746bdbb2c849 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:37.866702 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-32991751-6faf-4994-aee0-746bdbb2c849 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:37.875771 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-32991751-6faf-4994-aee0-746bdbb2c849 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1265 microversion: 2.1 time: 0.178915 Aug 31 09:56:37.876360 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 378/772] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:37 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:38.222846 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-51d72536-a1df-448e-8e2b-ff2e3b791ff1 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:38.223460 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-51d72536-a1df-448e-8e2b-ff2e3b791ff1 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:38.230200 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-51d72536-a1df-448e-8e2b-ff2e3b791ff1 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:38.230679 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-51d72536-a1df-448e-8e2b-ff2e3b791ff1 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:38.231208 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-51d72536-a1df-448e-8e2b-ff2e3b791ff1 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:38.231906 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-51d72536-a1df-448e-8e2b-ff2e3b791ff1 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:38.232347 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-51d72536-a1df-448e-8e2b-ff2e3b791ff1 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:38.232758 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-51d72536-a1df-448e-8e2b-ff2e3b791ff1 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:38.383513 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-51d72536-a1df-448e-8e2b-ff2e3b791ff1 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:38.393079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-51d72536-a1df-448e-8e2b-ff2e3b791ff1 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1573 microversion: 2.1 time: 0.174956 Aug 31 09:56:38.393724 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 395/773] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:38 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1573 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:38.898125 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-5e0adceb-fca6-4569-a903-621431d45c32 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:38.898814 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-5e0adceb-fca6-4569-a903-621431d45c32 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:38.905277 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5e0adceb-fca6-4569-a903-621431d45c32 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:38.905892 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5e0adceb-fca6-4569-a903-621431d45c32 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:38.906336 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5e0adceb-fca6-4569-a903-621431d45c32 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:38.907015 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5e0adceb-fca6-4569-a903-621431d45c32 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:38.907616 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5e0adceb-fca6-4569-a903-621431d45c32 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:38.908031 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5e0adceb-fca6-4569-a903-621431d45c32 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:39.042263 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-5e0adceb-fca6-4569-a903-621431d45c32 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:39.051198 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-5e0adceb-fca6-4569-a903-621431d45c32 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1265 microversion: 2.1 time: 0.157533 Aug 31 09:56:39.051789 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 379/774] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:38 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:39.416567 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-e4b0258a-7609-4312-a230-57032683cf5f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:39.417438 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-e4b0258a-7609-4312-a230-57032683cf5f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:39.424506 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e4b0258a-7609-4312-a230-57032683cf5f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:39.424994 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e4b0258a-7609-4312-a230-57032683cf5f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:39.425542 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e4b0258a-7609-4312-a230-57032683cf5f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:39.426421 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e4b0258a-7609-4312-a230-57032683cf5f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:39.426990 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e4b0258a-7609-4312-a230-57032683cf5f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:39.427674 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e4b0258a-7609-4312-a230-57032683cf5f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:39.569550 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-e4b0258a-7609-4312-a230-57032683cf5f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:39.577401 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-e4b0258a-7609-4312-a230-57032683cf5f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1573 microversion: 2.1 time: 0.165623 Aug 31 09:56:39.577975 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 396/775] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:39 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:40.078663 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-28665911-ca71-4132-a3e4-d83ab43b401b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:40.079450 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-28665911-ca71-4132-a3e4-d83ab43b401b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:40.086099 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-28665911-ca71-4132-a3e4-d83ab43b401b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:40.086584 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-28665911-ca71-4132-a3e4-d83ab43b401b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:40.087013 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-28665911-ca71-4132-a3e4-d83ab43b401b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:40.087699 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-28665911-ca71-4132-a3e4-d83ab43b401b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:40.088144 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-28665911-ca71-4132-a3e4-d83ab43b401b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:40.088558 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-28665911-ca71-4132-a3e4-d83ab43b401b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:40.223426 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-28665911-ca71-4132-a3e4-d83ab43b401b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:40.231449 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-28665911-ca71-4132-a3e4-d83ab43b401b tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1265 microversion: 2.1 time: 0.157272 Aug 31 09:56:40.231976 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 380/776] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:40 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:40.599473 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-427fd74f-b8ac-441c-862c-3bc13feb5d1d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:40.600046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-427fd74f-b8ac-441c-862c-3bc13feb5d1d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:40.608474 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-427fd74f-b8ac-441c-862c-3bc13feb5d1d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:40.609528 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-427fd74f-b8ac-441c-862c-3bc13feb5d1d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:40.610009 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-427fd74f-b8ac-441c-862c-3bc13feb5d1d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:40.610768 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-427fd74f-b8ac-441c-862c-3bc13feb5d1d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:40.611211 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-427fd74f-b8ac-441c-862c-3bc13feb5d1d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:40.611652 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-427fd74f-b8ac-441c-862c-3bc13feb5d1d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:40.774241 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-427fd74f-b8ac-441c-862c-3bc13feb5d1d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:40.783777 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-427fd74f-b8ac-441c-862c-3bc13feb5d1d tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1573 microversion: 2.1 time: 0.188233 Aug 31 09:56:40.784489 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 397/777] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:40 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1573 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:41.252827 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-64904c05-c96c-4a52-92c2-97333aa03e65 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:41.253447 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-64904c05-c96c-4a52-92c2-97333aa03e65 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:41.260380 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-64904c05-c96c-4a52-92c2-97333aa03e65 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:41.260857 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-64904c05-c96c-4a52-92c2-97333aa03e65 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:41.261285 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-64904c05-c96c-4a52-92c2-97333aa03e65 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:41.262008 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-64904c05-c96c-4a52-92c2-97333aa03e65 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:41.262457 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-64904c05-c96c-4a52-92c2-97333aa03e65 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:41.262871 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-64904c05-c96c-4a52-92c2-97333aa03e65 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:41.404137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-64904c05-c96c-4a52-92c2-97333aa03e65 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:41.413888 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-64904c05-c96c-4a52-92c2-97333aa03e65 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1265 microversion: 2.1 time: 0.164668 Aug 31 09:56:41.414599 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 381/778] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:41 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:41.807670 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-71193edf-8217-42fc-8540-31ffb25f5f6a tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:41.808521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-71193edf-8217-42fc-8540-31ffb25f5f6a tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:41.816543 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-71193edf-8217-42fc-8540-31ffb25f5f6a tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:41.817027 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-71193edf-8217-42fc-8540-31ffb25f5f6a tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:41.817520 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-71193edf-8217-42fc-8540-31ffb25f5f6a tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:41.818267 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-71193edf-8217-42fc-8540-31ffb25f5f6a tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:41.818715 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-71193edf-8217-42fc-8540-31ffb25f5f6a tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:41.819131 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-71193edf-8217-42fc-8540-31ffb25f5f6a tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:41.839309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:41.967841 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-71193edf-8217-42fc-8540-31ffb25f5f6a tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:41.977642 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-71193edf-8217-42fc-8540-31ffb25f5f6a tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1573 microversion: 2.1 time: 0.173321 Aug 31 09:56:41.977642 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 398/779] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:41 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1573 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:42.435257 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-250f573a-8d18-4bec-8156-7fc084ba5d72 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:42.435859 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-250f573a-8d18-4bec-8156-7fc084ba5d72 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:42.443054 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-250f573a-8d18-4bec-8156-7fc084ba5d72 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:42.443530 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-250f573a-8d18-4bec-8156-7fc084ba5d72 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:42.443957 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-250f573a-8d18-4bec-8156-7fc084ba5d72 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:42.444647 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-250f573a-8d18-4bec-8156-7fc084ba5d72 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:42.445097 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-250f573a-8d18-4bec-8156-7fc084ba5d72 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:42.445542 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-250f573a-8d18-4bec-8156-7fc084ba5d72 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:42.587671 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-250f573a-8d18-4bec-8156-7fc084ba5d72 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:42.596573 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-250f573a-8d18-4bec-8156-7fc084ba5d72 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1265 microversion: 2.1 time: 0.165071 Aug 31 09:56:42.597073 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 382/780] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:42 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:42.998306 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-d001fa68-e11e-4237-9463-911ff68f34ab tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:42.998929 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-d001fa68-e11e-4237-9463-911ff68f34ab tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:43.007314 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d001fa68-e11e-4237-9463-911ff68f34ab tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:43.007804 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d001fa68-e11e-4237-9463-911ff68f34ab tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:43.008232 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d001fa68-e11e-4237-9463-911ff68f34ab tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:43.009094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d001fa68-e11e-4237-9463-911ff68f34ab tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:43.009406 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d001fa68-e11e-4237-9463-911ff68f34ab tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:43.009825 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d001fa68-e11e-4237-9463-911ff68f34ab tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:43.164441 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-d001fa68-e11e-4237-9463-911ff68f34ab tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:43.179222 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-d001fa68-e11e-4237-9463-911ff68f34ab tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1573 microversion: 2.1 time: 0.184707 Aug 31 09:56:43.179830 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 399/781] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:42 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1573 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:43.619929 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-2e7abb74-cbd2-40a2-8631-03735b854d1a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:43.620513 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-2e7abb74-cbd2-40a2-8631-03735b854d1a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:43.628580 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2e7abb74-cbd2-40a2-8631-03735b854d1a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:43.629075 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2e7abb74-cbd2-40a2-8631-03735b854d1a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:43.629532 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2e7abb74-cbd2-40a2-8631-03735b854d1a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:43.630237 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2e7abb74-cbd2-40a2-8631-03735b854d1a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:43.630684 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2e7abb74-cbd2-40a2-8631-03735b854d1a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:43.631098 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2e7abb74-cbd2-40a2-8631-03735b854d1a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:43.635525 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=100 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:43.780479 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2e7abb74-cbd2-40a2-8631-03735b854d1a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:43.789959 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-2e7abb74-cbd2-40a2-8631-03735b854d1a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1265 microversion: 2.1 time: 0.174384 Aug 31 09:56:43.790760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 383/782] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:43 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:44.200193 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-bd5add74-1a18-4a8f-abde-4fba0a9ba9f6 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:44.200832 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-bd5add74-1a18-4a8f-abde-4fba0a9ba9f6 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:44.205734 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:44.209767 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bd5add74-1a18-4a8f-abde-4fba0a9ba9f6 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:44.210259 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bd5add74-1a18-4a8f-abde-4fba0a9ba9f6 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:44.210698 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bd5add74-1a18-4a8f-abde-4fba0a9ba9f6 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:44.211405 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bd5add74-1a18-4a8f-abde-4fba0a9ba9f6 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:44.211852 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bd5add74-1a18-4a8f-abde-4fba0a9ba9f6 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:44.212268 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bd5add74-1a18-4a8f-abde-4fba0a9ba9f6 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:44.369005 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-bd5add74-1a18-4a8f-abde-4fba0a9ba9f6 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:44.378007 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-bd5add74-1a18-4a8f-abde-4fba0a9ba9f6 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1573 microversion: 2.1 time: 0.181587 Aug 31 09:56:44.378647 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 400/783] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:44 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1573 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:44.816788 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-75686213-8e0d-421a-9631-ca7d900bf001 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:44.817445 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-75686213-8e0d-421a-9631-ca7d900bf001 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:44.823624 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-75686213-8e0d-421a-9631-ca7d900bf001 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:44.824106 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-75686213-8e0d-421a-9631-ca7d900bf001 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:44.824563 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-75686213-8e0d-421a-9631-ca7d900bf001 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:44.825253 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-75686213-8e0d-421a-9631-ca7d900bf001 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:44.825734 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-75686213-8e0d-421a-9631-ca7d900bf001 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:44.826166 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-75686213-8e0d-421a-9631-ca7d900bf001 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:44.988434 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-75686213-8e0d-421a-9631-ca7d900bf001 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:44.998166 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-75686213-8e0d-421a-9631-ca7d900bf001 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1265 microversion: 2.1 time: 0.185441 Aug 31 09:56:44.999098 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 384/784] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:44 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:45.415164 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f1f8a46a-bd97-4e0c-86b4-9618ed6fb137 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:45.415855 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-f1f8a46a-bd97-4e0c-86b4-9618ed6fb137 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:45.422988 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f1f8a46a-bd97-4e0c-86b4-9618ed6fb137 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:45.423483 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f1f8a46a-bd97-4e0c-86b4-9618ed6fb137 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:45.423918 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f1f8a46a-bd97-4e0c-86b4-9618ed6fb137 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:45.424617 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f1f8a46a-bd97-4e0c-86b4-9618ed6fb137 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:45.425227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f1f8a46a-bd97-4e0c-86b4-9618ed6fb137 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:45.425684 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f1f8a46a-bd97-4e0c-86b4-9618ed6fb137 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:45.546462 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-f956d3b0-7269-41d4-b383-c55009d73256 req-2986d4c9-b997-44e2-9c0e-9893aa17bfdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "482325e0-2a4b-4446-804a-0e3a1bcb722c", "name": "network-vif-plugged", "status": "completed", "tag": "6937ee29-5c42-40ef-97b4-9409defc0131"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:45.559760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:45.568199 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-f956d3b0-7269-41d4-b383-c55009d73256 req-2986d4c9-b997-44e2-9c0e-9893aa17bfdd service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:45.569496 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-f956d3b0-7269-41d4-b383-c55009d73256 req-2986d4c9-b997-44e2-9c0e-9893aa17bfdd service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:45.569942 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-f956d3b0-7269-41d4-b383-c55009d73256 req-2986d4c9-b997-44e2-9c0e-9893aa17bfdd service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:45.586324 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-f956d3b0-7269-41d4-b383-c55009d73256 req-2986d4c9-b997-44e2-9c0e-9893aa17bfdd service nova] Creating event network-vif-plugged:6937ee29-5c42-40ef-97b4-9409defc0131 for instance 482325e0-2a4b-4446-804a-0e3a1bcb722c on hv-cinder-84496 Aug 31 09:56:45.592879 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-f956d3b0-7269-41d4-b383-c55009d73256 req-2986d4c9-b997-44e2-9c0e-9893aa17bfdd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053721 Aug 31 09:56:45.593984 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 385/785] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:56:45.597090 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-f1f8a46a-bd97-4e0c-86b4-9618ed6fb137 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:45.608021 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-f1f8a46a-bd97-4e0c-86b4-9618ed6fb137 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1573 microversion: 2.1 time: 0.198216 Aug 31 09:56:45.608619 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 401/786] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:45 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1573 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:46.021303 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-a00bb064-2539-4d97-8eff-b55d18431d98 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:46.022028 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-a00bb064-2539-4d97-8eff-b55d18431d98 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:46.028980 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a00bb064-2539-4d97-8eff-b55d18431d98 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:46.029486 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a00bb064-2539-4d97-8eff-b55d18431d98 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:46.029914 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a00bb064-2539-4d97-8eff-b55d18431d98 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:46.030918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a00bb064-2539-4d97-8eff-b55d18431d98 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:46.031387 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a00bb064-2539-4d97-8eff-b55d18431d98 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:46.031803 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a00bb064-2539-4d97-8eff-b55d18431d98 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:46.182518 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-a00bb064-2539-4d97-8eff-b55d18431d98 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:46.191339 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-a00bb064-2539-4d97-8eff-b55d18431d98 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1265 microversion: 2.1 time: 0.174156 Aug 31 09:56:46.192129 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 386/787] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:46 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:46.630822 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-4d27613a-04f0-4576-aa4b-e01d90b15b92 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:46.631509 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-4d27613a-04f0-4576-aa4b-e01d90b15b92 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:46.637598 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4d27613a-04f0-4576-aa4b-e01d90b15b92 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:46.638085 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4d27613a-04f0-4576-aa4b-e01d90b15b92 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:46.638519 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4d27613a-04f0-4576-aa4b-e01d90b15b92 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:46.639208 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4d27613a-04f0-4576-aa4b-e01d90b15b92 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:46.639655 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4d27613a-04f0-4576-aa4b-e01d90b15b92 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:46.640305 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4d27613a-04f0-4576-aa4b-e01d90b15b92 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:46.785864 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-4d27613a-04f0-4576-aa4b-e01d90b15b92 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:46.794582 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-4d27613a-04f0-4576-aa4b-e01d90b15b92 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1573 microversion: 2.1 time: 0.168137 Aug 31 09:56:46.795164 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 402/788] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:46 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1573 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:47.212562 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9c5ea5fb-dfe2-4055-9926-a1e59b47434a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:47.213176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-9c5ea5fb-dfe2-4055-9926-a1e59b47434a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:47.219805 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9c5ea5fb-dfe2-4055-9926-a1e59b47434a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:47.220284 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9c5ea5fb-dfe2-4055-9926-a1e59b47434a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:47.220724 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9c5ea5fb-dfe2-4055-9926-a1e59b47434a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:47.221423 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9c5ea5fb-dfe2-4055-9926-a1e59b47434a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:47.221876 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9c5ea5fb-dfe2-4055-9926-a1e59b47434a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:47.222294 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9c5ea5fb-dfe2-4055-9926-a1e59b47434a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:47.361049 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-9c5ea5fb-dfe2-4055-9926-a1e59b47434a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:47.369992 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-9c5ea5fb-dfe2-4055-9926-a1e59b47434a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1265 microversion: 2.1 time: 0.161190 Aug 31 09:56:47.370586 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 387/789] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:47 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:47.612017 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-20092061-4be1-4f21-b1c3-c0cd30bb8d8d req-353609b1-7ae6-4c43-8dac-faeb76eaa24a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b32c74c-ed7a-496f-bf84-ce2d50e8b808", "name": "network-vif-plugged", "status": "completed", "tag": "a4adc3c8-d787-4f05-8cd2-ace7305b75c0"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:47.622074 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-20092061-4be1-4f21-b1c3-c0cd30bb8d8d req-353609b1-7ae6-4c43-8dac-faeb76eaa24a service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:47.622543 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-20092061-4be1-4f21-b1c3-c0cd30bb8d8d req-353609b1-7ae6-4c43-8dac-faeb76eaa24a service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:47.622964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-20092061-4be1-4f21-b1c3-c0cd30bb8d8d req-353609b1-7ae6-4c43-8dac-faeb76eaa24a service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:47.635204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-20092061-4be1-4f21-b1c3-c0cd30bb8d8d req-353609b1-7ae6-4c43-8dac-faeb76eaa24a service nova] Creating event network-vif-plugged:a4adc3c8-d787-4f05-8cd2-ace7305b75c0 for instance 1b32c74c-ed7a-496f-bf84-ce2d50e8b808 on hv-cinder-84496 Aug 31 09:56:47.640699 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-20092061-4be1-4f21-b1c3-c0cd30bb8d8d req-353609b1-7ae6-4c43-8dac-faeb76eaa24a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032854 Aug 31 09:56:47.641553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 403/790] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:56:47.816816 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-ae625aa4-7af3-44c3-a43b-dbb0d93aeab4 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:47.817345 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-ae625aa4-7af3-44c3-a43b-dbb0d93aeab4 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:47.823279 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ae625aa4-7af3-44c3-a43b-dbb0d93aeab4 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:47.823777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ae625aa4-7af3-44c3-a43b-dbb0d93aeab4 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:47.824204 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ae625aa4-7af3-44c3-a43b-dbb0d93aeab4 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:47.824887 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ae625aa4-7af3-44c3-a43b-dbb0d93aeab4 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:47.825337 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ae625aa4-7af3-44c3-a43b-dbb0d93aeab4 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:47.825772 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ae625aa4-7af3-44c3-a43b-dbb0d93aeab4 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:47.959244 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-ae625aa4-7af3-44c3-a43b-dbb0d93aeab4 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:47.967113 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-ae625aa4-7af3-44c3-a43b-dbb0d93aeab4 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1573 microversion: 2.1 time: 0.154396 Aug 31 09:56:47.967682 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 388/791] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:47 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:48.392371 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f9852a57-7989-4ffe-ad74-73e7778f4be8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:48.393069 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-f9852a57-7989-4ffe-ad74-73e7778f4be8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:48.399418 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f9852a57-7989-4ffe-ad74-73e7778f4be8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:48.399833 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f9852a57-7989-4ffe-ad74-73e7778f4be8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:48.400306 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f9852a57-7989-4ffe-ad74-73e7778f4be8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:48.400998 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f9852a57-7989-4ffe-ad74-73e7778f4be8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:48.401475 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f9852a57-7989-4ffe-ad74-73e7778f4be8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:48.401899 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f9852a57-7989-4ffe-ad74-73e7778f4be8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:48.547929 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-f9852a57-7989-4ffe-ad74-73e7778f4be8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:48.556555 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-f9852a57-7989-4ffe-ad74-73e7778f4be8 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1451 microversion: 2.1 time: 0.168504 Aug 31 09:56:48.557277 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 404/792] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:48 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1451 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:48.577533 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9d32f976-4d8e-4940-a8ef-7fd1b8468ff1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:48.578211 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-9d32f976-4d8e-4940-a8ef-7fd1b8468ff1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:48.584588 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9d32f976-4d8e-4940-a8ef-7fd1b8468ff1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:48.585068 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9d32f976-4d8e-4940-a8ef-7fd1b8468ff1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:48.585528 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9d32f976-4d8e-4940-a8ef-7fd1b8468ff1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:48.586215 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9d32f976-4d8e-4940-a8ef-7fd1b8468ff1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:48.586661 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9d32f976-4d8e-4940-a8ef-7fd1b8468ff1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:48.587071 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9d32f976-4d8e-4940-a8ef-7fd1b8468ff1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:48.745157 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-9d32f976-4d8e-4940-a8ef-7fd1b8468ff1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:48.753873 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-9d32f976-4d8e-4940-a8ef-7fd1b8468ff1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1451 microversion: 2.1 time: 0.180180 Aug 31 09:56:48.754507 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 389/793] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:48 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1451 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:48.988898 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-3a78a8eb-0c37-4699-9d85-39e79473c872 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:48.989534 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-3a78a8eb-0c37-4699-9d85-39e79473c872 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:48.996346 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3a78a8eb-0c37-4699-9d85-39e79473c872 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:48.996869 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3a78a8eb-0c37-4699-9d85-39e79473c872 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:48.997466 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3a78a8eb-0c37-4699-9d85-39e79473c872 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:48.998391 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3a78a8eb-0c37-4699-9d85-39e79473c872 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:48.998881 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3a78a8eb-0c37-4699-9d85-39e79473c872 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:49.000000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3a78a8eb-0c37-4699-9d85-39e79473c872 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:49.141071 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-3a78a8eb-0c37-4699-9d85-39e79473c872 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:49.149889 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-3a78a8eb-0c37-4699-9d85-39e79473c872 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1573 microversion: 2.1 time: 0.164788 Aug 31 09:56:49.150479 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 405/794] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:48 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:50.170759 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-db6c5e6f-6089-414e-bfa3-bdf76d1fef76 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:50.171471 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-db6c5e6f-6089-414e-bfa3-bdf76d1fef76 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:50.179264 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-db6c5e6f-6089-414e-bfa3-bdf76d1fef76 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:50.179512 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-db6c5e6f-6089-414e-bfa3-bdf76d1fef76 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:50.179949 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-db6c5e6f-6089-414e-bfa3-bdf76d1fef76 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:50.180647 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-db6c5e6f-6089-414e-bfa3-bdf76d1fef76 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:50.181096 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-db6c5e6f-6089-414e-bfa3-bdf76d1fef76 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:50.181543 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-db6c5e6f-6089-414e-bfa3-bdf76d1fef76 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:50.323398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-db6c5e6f-6089-414e-bfa3-bdf76d1fef76 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:50.332739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-db6c5e6f-6089-414e-bfa3-bdf76d1fef76 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1573 microversion: 2.1 time: 0.165767 Aug 31 09:56:50.333667 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 390/795] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:50 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:50.437813 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-e95f2361-e461-4482-b6c4-7c241653ce46 req-efb5c190-37e6-408f-a568-5adeb08e3706 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "482325e0-2a4b-4446-804a-0e3a1bcb722c", "tag": "6937ee29-5c42-40ef-97b4-9409defc0131"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:50.447780 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-e95f2361-e461-4482-b6c4-7c241653ce46 req-efb5c190-37e6-408f-a568-5adeb08e3706 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:50.448351 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-e95f2361-e461-4482-b6c4-7c241653ce46 req-efb5c190-37e6-408f-a568-5adeb08e3706 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:50.448850 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-e95f2361-e461-4482-b6c4-7c241653ce46 req-efb5c190-37e6-408f-a568-5adeb08e3706 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:50.461770 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-e95f2361-e461-4482-b6c4-7c241653ce46 req-efb5c190-37e6-408f-a568-5adeb08e3706 service nova] Creating event network-changed:6937ee29-5c42-40ef-97b4-9409defc0131 for instance 482325e0-2a4b-4446-804a-0e3a1bcb722c on hv-cinder-84496 Aug 31 09:56:50.467100 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-e95f2361-e461-4482-b6c4-7c241653ce46 req-efb5c190-37e6-408f-a568-5adeb08e3706 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033581 Aug 31 09:56:50.467797 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 406/796] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:56:51.355477 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-8f4cc543-3dfb-4ca5-a24c-c2a0ebd5613e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:51.356729 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-8f4cc543-3dfb-4ca5-a24c-c2a0ebd5613e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:51.367074 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8f4cc543-3dfb-4ca5-a24c-c2a0ebd5613e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:51.367662 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8f4cc543-3dfb-4ca5-a24c-c2a0ebd5613e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:51.368340 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8f4cc543-3dfb-4ca5-a24c-c2a0ebd5613e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:51.369123 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8f4cc543-3dfb-4ca5-a24c-c2a0ebd5613e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:51.369671 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8f4cc543-3dfb-4ca5-a24c-c2a0ebd5613e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:51.370185 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8f4cc543-3dfb-4ca5-a24c-c2a0ebd5613e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:51.609176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-8f4cc543-3dfb-4ca5-a24c-c2a0ebd5613e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:51.614187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-8f4cc543-3dfb-4ca5-a24c-c2a0ebd5613e tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1560 microversion: 2.1 time: 0.261364 Aug 31 09:56:51.614187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 391/797] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:51 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1560 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:18.858949 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=12 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:18.859785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=42 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:18.865480 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-c6a5b0eb-899f-4db1-b9c6-86e52113aba7 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:18.866090 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-c6a5b0eb-899f-4db1-b9c6-86e52113aba7 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:18.873023 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c6a5b0eb-899f-4db1-b9c6-86e52113aba7 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:18.873537 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c6a5b0eb-899f-4db1-b9c6-86e52113aba7 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:18.873965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c6a5b0eb-899f-4db1-b9c6-86e52113aba7 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:18.874645 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c6a5b0eb-899f-4db1-b9c6-86e52113aba7 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:18.875093 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c6a5b0eb-899f-4db1-b9c6-86e52113aba7 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:18.875513 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c6a5b0eb-899f-4db1-b9c6-86e52113aba7 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:18.899919 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-c6a5b0eb-899f-4db1-b9c6-86e52113aba7 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3/ips" status: 200 len: 148 microversion: 2.1 time: 0.042730 Aug 31 09:57:18.900491 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 407/798] 10.222.0.13 () {58 vars in 1248 bytes} [Wed Aug 31 09:57:18 2022] GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3/ips => generated 148 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:57:20.248930 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c11318dd-f826-48b3-9761-a8671edae7be tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0f6bfe3-0f9e-4337-8612-6790fb42a5b1"}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:57:20.251363 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c11318dd-f826-48b3-9761-a8671edae7be tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:20.253806 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=13 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:20.254479 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=48 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:20.260866 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c11318dd-f826-48b3-9761-a8671edae7be tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:20.261340 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c11318dd-f826-48b3-9761-a8671edae7be tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:20.261792 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c11318dd-f826-48b3-9761-a8671edae7be tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:20.262606 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c11318dd-f826-48b3-9761-a8671edae7be tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:20.263071 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c11318dd-f826-48b3-9761-a8671edae7be tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:20.263470 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c11318dd-f826-48b3-9761-a8671edae7be tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:20.562499 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c11318dd-f826-48b3-9761-a8671edae7be tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "POST /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318180 Aug 31 09:57:20.563301 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 392/799] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 31 09:57:20 2022] POST /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:57:28.156369 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-8b1e2cc1-d4ec-4f6f-9103-6fd29ffc8922 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0f6bfe3-0f9e-4337-8612-6790fb42a5b1"}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:57:28.161241 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-8b1e2cc1-d4ec-4f6f-9103-6fd29ffc8922 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:28.173042 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8b1e2cc1-d4ec-4f6f-9103-6fd29ffc8922 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:28.173981 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8b1e2cc1-d4ec-4f6f-9103-6fd29ffc8922 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:28.174853 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8b1e2cc1-d4ec-4f6f-9103-6fd29ffc8922 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:28.176364 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8b1e2cc1-d4ec-4f6f-9103-6fd29ffc8922 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:28.177060 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8b1e2cc1-d4ec-4f6f-9103-6fd29ffc8922 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:28.177700 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8b1e2cc1-d4ec-4f6f-9103-6fd29ffc8922 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:28.299041 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-8b1e2cc1-d4ec-4f6f-9103-6fd29ffc8922 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] HTTP exception thrown: Invalid volume: volume e0f6bfe3-0f9e-4337-8612-6790fb42a5b1 is already attached to instances: a3238242-6707-4564-b749-b478f64967f3 Aug 31 09:57:28.302079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-8b1e2cc1-d4ec-4f6f-9103-6fd29ffc8922 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Request method failure captured: Aug 31 09:57:28.302079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: POST /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3/os-volume_attachments HTTP/1.1 Aug 31 09:57:28.302079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 09:57:28.302079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 09:57:28.302079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 09:57:28.302079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 74 Aug 31 09:57:28.302079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 09:57:28.302079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 09:57:28.302079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 09:57:28.302079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 09:57:28.302079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy6sN1dq8bwJPS_jK4T_eY89XY484BzJuR68dlflJc6VvZgYE_FtzceTKQW1kiHPXFi1h_ZI_jnv2y63cuWWAmCtmFfvmGj6lmJqh816MDH_lQt4Qw0fH63qKXCoQUNRNnOITiuKYSI6cXUru5wJe9L6kAmQya7lhE-_AhxPVCJKUbM Aug 31 09:57:28.302079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 09:57:28.302079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 09:57:28.302079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 09:57:28.302079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 09:57:28.302079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 09:57:28.302079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 09:57:28.302079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:57:28.302079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:57:28.302079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 09:57:28.302079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 09:57:28.303683 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5ed9143757584694a5139ada8dbd5570"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:57:28.303683 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:57:28.303683 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:57:28.303683 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:57:28.303683 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:57:28.303683 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 09:57:28.303683 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 09:57:28.303683 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: 25b4233e5f0e41bf99b3fb3f5f6229c9 Aug 31 09:57:28.303683 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:57:28.303683 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Aug 31 09:57:28.303683 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {"volumeAttachment": {"volumeId": "e0f6bfe3-0f9e-4337-8612-6790fb42a5b1"}} Aug 31 09:57:28.303683 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 09:57:28.304445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Invalid volume: volume e0f6bfe3-0f9e-4337-8612-6790fb42a5b1 is already attached to instances: a3238242-6707-4564-b749-b478f64967f3 Aug 31 09:57:28.304445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'server_id': 'a3238242-6707-4564-b749-b478f64967f3', 'body': {'volumeAttachment': {'volumeId': 'e0f6bfe3-0f9e-4337-8612-6790fb42a5b1'}}} Aug 31 09:57:28.304445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:57:28.304445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:57:28.304445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 09:57:28.304445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 09:57:28.304445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 09:57:28.304445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 09:57:28.304445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 09:57:28.304445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 09:57:28.304445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 09:57:28.304445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 09:57:28.304445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 09:57:28.304445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 09:57:28.304445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e0f6bfe3-0f9e-4337-8612-6790fb42a5b1 is already attached to instances: a3238242-6707-4564-b749-b478f64967f3 Aug 31 09:57:28.304445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:57:28.304445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:57:28.304445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:57:28.304445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:57:28.306046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:57:28.306046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:57:28.306046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:57:28.306046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:57:28.306046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:57:28.306046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:57:28.306046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:57:28.306046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:57:28.306046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:57:28.306046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:57:28.306046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:57:28.306046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:57:28.306046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 09:57:28.306046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 09:57:28.306046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e0f6bfe3-0f9e-4337-8612-6790fb42a5b1 is already attached to instances: a3238242-6707-4564-b749-b478f64967f3 Aug 31 09:57:28.306046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:57:28.306046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:57:28.306046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:57:28.306046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:57:28.306046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:57:28.307261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:57:28.307261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:57:28.307261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:57:28.307261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e0f6bfe3-0f9e-4337-8612-6790fb42a5b1 is already attached to instances: a3238242-6707-4564-b749-b478f64967f3 Aug 31 09:57:28.307261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:57:28.307261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-8b1e2cc1-d4ec-4f6f-9103-6fd29ffc8922 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Returning 400 to user: Invalid volume: volume e0f6bfe3-0f9e-4337-8612-6790fb42a5b1 is already attached to instances: a3238242-6707-4564-b749-b478f64967f3 {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:57:28.307261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-8b1e2cc1-d4ec-4f6f-9103-6fd29ffc8922 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "POST /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.155485 Aug 31 09:57:28.307261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 408/800] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 31 09:57:28 2022] POST /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3/os-volume_attachments => generated 174 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 09:57:28.391918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-511cc963-bbfa-4ba2-80b7-806e60cd9b53 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:28.392519 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-511cc963-bbfa-4ba2-80b7-806e60cd9b53 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:28.400226 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-511cc963-bbfa-4ba2-80b7-806e60cd9b53 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:28.400719 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-511cc963-bbfa-4ba2-80b7-806e60cd9b53 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:28.401160 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-511cc963-bbfa-4ba2-80b7-806e60cd9b53 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:28.401982 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-511cc963-bbfa-4ba2-80b7-806e60cd9b53 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:28.402365 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-511cc963-bbfa-4ba2-80b7-806e60cd9b53 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:28.402793 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-511cc963-bbfa-4ba2-80b7-806e60cd9b53 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:28.499457 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.objects.instance [None req-511cc963-bbfa-4ba2-80b7-806e60cd9b53 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lazy-loading 'services' on Instance uuid a3238242-6707-4564-b749-b478f64967f3 {{(pid=127171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:57:28.587247 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-511cc963-bbfa-4ba2-80b7-806e60cd9b53 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3/os-volume_attachments/e0f6bfe3-0f9e-4337-8612-6790fb42a5b1" status: 202 len: 0 microversion: 2.1 time: 0.199584 Aug 31 09:57:28.588298 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 393/801] 10.222.0.13 () {58 vars in 1416 bytes} [Wed Aug 31 09:57:28 2022] DELETE /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3/os-volume_attachments/e0f6bfe3-0f9e-4337-8612-6790fb42a5b1 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:57:28.601796 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-159c44bf-ee03-4fec-9843-f1e2fb8ea8e4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:28.605504 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-159c44bf-ee03-4fec-9843-f1e2fb8ea8e4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:28.614845 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-159c44bf-ee03-4fec-9843-f1e2fb8ea8e4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:28.615518 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-159c44bf-ee03-4fec-9843-f1e2fb8ea8e4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:28.615999 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-159c44bf-ee03-4fec-9843-f1e2fb8ea8e4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:28.616827 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-159c44bf-ee03-4fec-9843-f1e2fb8ea8e4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:28.617330 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-159c44bf-ee03-4fec-9843-f1e2fb8ea8e4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:28.617939 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-159c44bf-ee03-4fec-9843-f1e2fb8ea8e4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:28.652967 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-159c44bf-ee03-4fec-9843-f1e2fb8ea8e4 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058562 Aug 31 09:57:28.653584 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 409/802] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 31 09:57:28 2022] GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:57:29.667771 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c815b6f8-e944-4657-951b-a670332a9eda tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:29.670452 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c815b6f8-e944-4657-951b-a670332a9eda tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:29.677377 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c815b6f8-e944-4657-951b-a670332a9eda tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:29.677899 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c815b6f8-e944-4657-951b-a670332a9eda tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:29.678337 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c815b6f8-e944-4657-951b-a670332a9eda tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:29.679051 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c815b6f8-e944-4657-951b-a670332a9eda tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:29.679511 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c815b6f8-e944-4657-951b-a670332a9eda tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:29.679937 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c815b6f8-e944-4657-951b-a670332a9eda tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:29.717335 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c815b6f8-e944-4657-951b-a670332a9eda tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054607 Aug 31 09:57:29.717962 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 394/803] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 31 09:57:29 2022] GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:57:30.731652 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-2912cd04-e08d-4598-9f4c-e2e8bd0694f9 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:30.734314 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-2912cd04-e08d-4598-9f4c-e2e8bd0694f9 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:30.742471 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2912cd04-e08d-4598-9f4c-e2e8bd0694f9 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:30.743075 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2912cd04-e08d-4598-9f4c-e2e8bd0694f9 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:30.743543 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2912cd04-e08d-4598-9f4c-e2e8bd0694f9 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:30.744377 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2912cd04-e08d-4598-9f4c-e2e8bd0694f9 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:30.744868 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2912cd04-e08d-4598-9f4c-e2e8bd0694f9 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:30.745339 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2912cd04-e08d-4598-9f4c-e2e8bd0694f9 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:30.786966 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-2912cd04-e08d-4598-9f4c-e2e8bd0694f9 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059371 Aug 31 09:57:30.787692 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 410/804] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 31 09:57:30 2022] GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 09:57:30.865191 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9fa484c3-559a-4a29-8842-a32e8c809da8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:30.865914 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-9fa484c3-559a-4a29-8842-a32e8c809da8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:30.873440 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9fa484c3-559a-4a29-8842-a32e8c809da8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:30.873933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9fa484c3-559a-4a29-8842-a32e8c809da8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:30.874371 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9fa484c3-559a-4a29-8842-a32e8c809da8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:30.875093 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9fa484c3-559a-4a29-8842-a32e8c809da8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:30.875632 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9fa484c3-559a-4a29-8842-a32e8c809da8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:30.876275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9fa484c3-559a-4a29-8842-a32e8c809da8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:30.907289 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-9fa484c3-559a-4a29-8842-a32e8c809da8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Going to try to terminate instance {{(pid=127171) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:57:31.009597 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-9fa484c3-559a-4a29-8842-a32e8c809da8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3" status: 204 len: 0 microversion: 2.1 time: 0.147926 Aug 31 09:57:31.010526 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 395/805] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 09:57:30 2022] DELETE /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:57:31.021762 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-149984bf-d2e8-4577-90e7-6a5870fe647f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:31.022368 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-149984bf-d2e8-4577-90e7-6a5870fe647f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:31.029691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-149984bf-d2e8-4577-90e7-6a5870fe647f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:31.032249 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-149984bf-d2e8-4577-90e7-6a5870fe647f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:31.032249 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-149984bf-d2e8-4577-90e7-6a5870fe647f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:31.032249 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-149984bf-d2e8-4577-90e7-6a5870fe647f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:31.032249 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-149984bf-d2e8-4577-90e7-6a5870fe647f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:31.032955 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-149984bf-d2e8-4577-90e7-6a5870fe647f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:31.204730 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-149984bf-d2e8-4577-90e7-6a5870fe647f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:31.214137 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-149984bf-d2e8-4577-90e7-6a5870fe647f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3" status: 200 len: 1679 microversion: 2.1 time: 0.197430 Aug 31 09:57:31.214963 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 411/806] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:31 2022] GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3 => generated 1679 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:32.244090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-743ea66d-5e12-4b10-aa59-afd8005d841f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:32.245346 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-743ea66d-5e12-4b10-aa59-afd8005d841f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:32.257972 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-743ea66d-5e12-4b10-aa59-afd8005d841f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:32.258885 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-743ea66d-5e12-4b10-aa59-afd8005d841f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:32.259725 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-743ea66d-5e12-4b10-aa59-afd8005d841f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:32.261051 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-743ea66d-5e12-4b10-aa59-afd8005d841f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:32.261970 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-743ea66d-5e12-4b10-aa59-afd8005d841f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:32.262745 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-743ea66d-5e12-4b10-aa59-afd8005d841f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:32.429476 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-743ea66d-5e12-4b10-aa59-afd8005d841f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:32.437857 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-743ea66d-5e12-4b10-aa59-afd8005d841f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3" status: 200 len: 1679 microversion: 2.1 time: 0.202444 Aug 31 09:57:32.438522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 396/807] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:32 2022] GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3 => generated 1679 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:33.460790 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-ca52145a-7553-430d-bedd-6d04d9b7d840 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:33.461683 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-ca52145a-7553-430d-bedd-6d04d9b7d840 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:33.467546 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ca52145a-7553-430d-bedd-6d04d9b7d840 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:33.467808 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ca52145a-7553-430d-bedd-6d04d9b7d840 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:33.468246 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ca52145a-7553-430d-bedd-6d04d9b7d840 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:33.468951 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ca52145a-7553-430d-bedd-6d04d9b7d840 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:33.469462 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ca52145a-7553-430d-bedd-6d04d9b7d840 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:33.469892 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ca52145a-7553-430d-bedd-6d04d9b7d840 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:33.719529 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-ca52145a-7553-430d-bedd-6d04d9b7d840 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:33.731286 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-ca52145a-7553-430d-bedd-6d04d9b7d840 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3" status: 200 len: 1679 microversion: 2.1 time: 0.274970 Aug 31 09:57:33.731889 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 412/808] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:33 2022] GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3 => generated 1679 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:34.339919 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-51371665-e0bc-48ec-a8ca-d0a5b16d371b req-87335a42-33ff-45e5-a843-479d8a295d10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3238242-6707-4564-b749-b478f64967f3", "name": "network-vif-deleted", "tag": "06438076-47dd-4bdb-a71f-1a49e57a577f"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:57:34.358947 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-51371665-e0bc-48ec-a8ca-d0a5b16d371b req-87335a42-33ff-45e5-a843-479d8a295d10 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:34.362704 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-51371665-e0bc-48ec-a8ca-d0a5b16d371b req-87335a42-33ff-45e5-a843-479d8a295d10 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:34.368968 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-51371665-e0bc-48ec-a8ca-d0a5b16d371b req-87335a42-33ff-45e5-a843-479d8a295d10 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:34.395995 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-51371665-e0bc-48ec-a8ca-d0a5b16d371b req-87335a42-33ff-45e5-a843-479d8a295d10 service nova] Creating event network-vif-deleted:06438076-47dd-4bdb-a71f-1a49e57a577f for instance a3238242-6707-4564-b749-b478f64967f3 on hv-cinder-84496 Aug 31 09:57:34.401814 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-51371665-e0bc-48ec-a8ca-d0a5b16d371b req-87335a42-33ff-45e5-a843-479d8a295d10 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065501 Aug 31 09:57:34.402507 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 397/809] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:57:34.770435 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-23e1492e-8998-4934-8a0f-0efff0d9c3fb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:34.771193 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-23e1492e-8998-4934-8a0f-0efff0d9c3fb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:34.778141 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-23e1492e-8998-4934-8a0f-0efff0d9c3fb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:34.778546 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-23e1492e-8998-4934-8a0f-0efff0d9c3fb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:34.778987 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-23e1492e-8998-4934-8a0f-0efff0d9c3fb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:34.779690 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-23e1492e-8998-4934-8a0f-0efff0d9c3fb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:34.780141 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-23e1492e-8998-4934-8a0f-0efff0d9c3fb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:34.780564 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-23e1492e-8998-4934-8a0f-0efff0d9c3fb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:34.814809 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-23e1492e-8998-4934-8a0f-0efff0d9c3fb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:34.815408 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-23e1492e-8998-4934-8a0f-0efff0d9c3fb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:34.815927 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-23e1492e-8998-4934-8a0f-0efff0d9c3fb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:34.816363 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.objects.instance [None req-23e1492e-8998-4934-8a0f-0efff0d9c3fb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lazy-loading 'fault' on Instance uuid a3238242-6707-4564-b749-b478f64967f3 {{(pid=127170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:57:34.866781 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-23e1492e-8998-4934-8a0f-0efff0d9c3fb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:34.875065 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-23e1492e-8998-4934-8a0f-0efff0d9c3fb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3" status: 200 len: 1331 microversion: 2.1 time: 0.110197 Aug 31 09:57:34.875758 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 413/810] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:34 2022] GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3 => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:35.899879 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-03a3c957-b4bd-4f3c-92ec-580137b35484 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:35.900644 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-03a3c957-b4bd-4f3c-92ec-580137b35484 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:35.907294 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-03a3c957-b4bd-4f3c-92ec-580137b35484 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:35.907788 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-03a3c957-b4bd-4f3c-92ec-580137b35484 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:35.908212 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-03a3c957-b4bd-4f3c-92ec-580137b35484 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:35.908938 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-03a3c957-b4bd-4f3c-92ec-580137b35484 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:35.909418 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-03a3c957-b4bd-4f3c-92ec-580137b35484 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:35.909871 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-03a3c957-b4bd-4f3c-92ec-580137b35484 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:35.925933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.wsgi [None req-03a3c957-b4bd-4f3c-92ec-580137b35484 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] HTTP exception thrown: Instance a3238242-6707-4564-b749-b478f64967f3 could not be found. Aug 31 09:57:35.927918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-03a3c957-b4bd-4f3c-92ec-580137b35484 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Request method failure captured: Aug 31 09:57:35.927918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: request: GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3 HTTP/1.1 Aug 31 09:57:35.927918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept: application/json Aug 31 09:57:35.927918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept-Encoding: identity Aug 31 09:57:35.927918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Connection: close Aug 31 09:57:35.927918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Length: 0 Aug 31 09:57:35.927918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Type: application/json Aug 31 09:57:35.927918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Host: 10.222.0.13 Aug 31 09:57:35.927918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Openstack-System-Scope: None Aug 31 09:57:35.927918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: User-Agent: python-urllib3/1.26.12 Aug 31 09:57:35.927918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Auth-Token: gAAAAABjDy6sN1dq8bwJPS_jK4T_eY89XY484BzJuR68dlflJc6VvZgYE_FtzceTKQW1kiHPXFi1h_ZI_jnv2y63cuWWAmCtmFfvmGj6lmJqh816MDH_lQt4Qw0fH63qKXCoQUNRNnOITiuKYSI6cXUru5wJe9L6kAmQya7lhE-_AhxPVCJKUbM Aug 31 09:57:35.927918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Id: None Aug 31 09:57:35.927918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Name: None Aug 31 09:57:35.927918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Identity-Status: Confirmed Aug 31 09:57:35.927918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Is-Admin-Project: True Aug 31 09:57:35.927918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Id: default Aug 31 09:57:35.927918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Name: Default Aug 31 09:57:35.927918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:57:35.927918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:57:35.927918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Role: member,reader Aug 31 09:57:35.927918 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Roles: member,reader Aug 31 09:57:35.930405 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5ed9143757584694a5139ada8dbd5570"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:57:35.930405 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:57:35.930405 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:57:35.930405 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:57:35.930405 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:57:35.930405 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Id: default Aug 31 09:57:35.930405 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Name: Default Aug 31 09:57:35.930405 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Id: 25b4233e5f0e41bf99b3fb3f5f6229c9 Aug 31 09:57:35.930405 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Name: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:57:35.930405 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: method: > Aug 31 09:57:35.930405 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: exception: Instance a3238242-6707-4564-b749-b478f64967f3 could not be found. Aug 31 09:57:35.930405 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: action_args: {'id': 'a3238242-6707-4564-b749-b478f64967f3'} Aug 31 09:57:35.931732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:57:35.931732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:57:35.931732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:57:35.931732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:57:35.931732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:57:35.931732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:57:35.931732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:57:35.931732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:57:35.931732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:57:35.931732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:57:35.931732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3238242-6707-4564-b749-b478f64967f3 could not be found. Aug 31 09:57:35.931732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:57:35.931732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:57:35.931732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:57:35.931732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:57:35.931732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:57:35.931732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:57:35.931732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:57:35.931732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:57:35.931732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:57:35.934030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:57:35.934030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:57:35.934030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:57:35.934030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:57:35.934030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:57:35.934030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:57:35.934030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:57:35.934030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3238242-6707-4564-b749-b478f64967f3 could not be found. Aug 31 09:57:35.934030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:57:35.934030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:57:35.934030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:57:35.934030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:57:35.934030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:57:35.934030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:57:35.934030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:57:35.934030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:57:35.934030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3238242-6707-4564-b749-b478f64967f3 could not be found. Aug 31 09:57:35.934030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:57:35.936268 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-03a3c957-b4bd-4f3c-92ec-580137b35484 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Returning 404 to user: Instance a3238242-6707-4564-b749-b478f64967f3 could not be found. {{(pid=127171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:57:35.936268 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-03a3c957-b4bd-4f3c-92ec-580137b35484 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3" status: 404 len: 111 microversion: 2.1 time: 0.035471 Aug 31 09:57:35.936268 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 398/811] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:35 2022] GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:57:35.940044 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-3dd01595-c692-4272-b821-4bcd64262f69 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '.version_select at 0x7f5503d221f0>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:35.964073 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-3dd01595-c692-4272-b821-4bcd64262f69 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1451865228" status: 202 len: 0 microversion: 2.1 time: 0.028376 Aug 31 09:57:35.964644 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 414/812] 10.222.0.13 () {58 vars in 1221 bytes} [Wed Aug 31 09:57:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1451865228 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:57:36.823936 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-a7c697a2-5014-4313-b904-205cd6227f0d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Action: 'create', calling method: .version_select at 0x7f5503d6fca0>, body: {"keypair": {"name": "tempest-keypair-1905289023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1hqR8Gc9++vUY25HGp+fJ/bDmVZHRa+V+6L9nqUSGfoiDuDAKATT6dBaY4JP2t2Ajsc+Mf6Z0s5zyWhqkCKtKB4F4F7qHEMm/5YkkCajFsysiVaZPvGtVz0z92/o8Hyg=="}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:57:36.844242 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-a7c697a2-5014-4313-b904-205cd6227f0d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Getting quotas for project 5ed9143757584694a5139ada8dbd5570. Resources: {'key_pairs'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:57:36.850343 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-a7c697a2-5014-4313-b904-205cd6227f0d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Getting quotas for user 25b4233e5f0e41bf99b3fb3f5f6229c9 and project 5ed9143757584694a5139ada8dbd5570. Resources: {'key_pairs'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:57:36.875826 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-a7c697a2-5014-4313-b904-205cd6227f0d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056210 Aug 31 09:57:36.876437 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 399/813] 10.222.0.13 () {60 vars in 1159 bytes} [Wed Aug 31 09:57:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:57:38.874637 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-5084eb5b-3381-4f8f-ba13-4550b1fa585f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-692508899", "imageRef": "8e078bb9-f274-4984-8128-d31407d49604", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ba3d70db-89a3-4a36-91f7-576971d6cd3f"}], "security_groups": [{"name": "tempest-securitygroup--1548954989"}], "key_name": "tempest-keypair-1905289023", "user_data": "}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:57:39.000983 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.network.neutron [None req-5084eb5b-3381-4f8f-ba13-4550b1fa585f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] validate_networks() for [('ba3d70db-89a3-4a36-91f7-576971d6cd3f', None, None, None, None, None)] {{(pid=127170) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:57:39.470597 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-5084eb5b-3381-4f8f-ba13-4550b1fa585f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Flavor limits 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:57:39.471010 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-5084eb5b-3381-4f8f-ba13-4550b1fa585f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Image limits 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:57:39.471576 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-5084eb5b-3381-4f8f-ba13-4550b1fa585f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Flavor pref 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:57:39.472203 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-5084eb5b-3381-4f8f-ba13-4550b1fa585f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Image pref 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:57:39.472781 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-5084eb5b-3381-4f8f-ba13-4550b1fa585f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:57:39.482830 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5084eb5b-3381-4f8f-ba13-4550b1fa585f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:39.483309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5084eb5b-3381-4f8f-ba13-4550b1fa585f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:39.483735 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5084eb5b-3381-4f8f-ba13-4550b1fa585f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:39.484465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5084eb5b-3381-4f8f-ba13-4550b1fa585f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:39.484915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5084eb5b-3381-4f8f-ba13-4550b1fa585f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:39.485339 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5084eb5b-3381-4f8f-ba13-4550b1fa585f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:39.506914 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-5084eb5b-3381-4f8f-ba13-4550b1fa585f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Getting quotas for project 5ed9143757584694a5139ada8dbd5570. Resources: {'ram', 'instances', 'cores'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:57:39.512180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-5084eb5b-3381-4f8f-ba13-4550b1fa585f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Getting quotas for user 25b4233e5f0e41bf99b3fb3f5f6229c9 and project 5ed9143757584694a5139ada8dbd5570. Resources: {'ram', 'instances', 'cores'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:57:39.526724 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-5084eb5b-3381-4f8f-ba13-4550b1fa585f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Going to run 1 instances... {{(pid=127170) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:57:39.529081 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-5084eb5b-3381-4f8f-ba13-4550b1fa585f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8e078bb9-f274-4984-8128-d31407d49604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:57:39.585091 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-5084eb5b-3381-4f8f-ba13-4550b1fa585f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.715513 Aug 31 09:57:39.585798 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 415/814] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 31 09:57:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 09:57:39.598683 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-e6ad9e3d-e957-40b2-ae1d-6afdf86319c2 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:39.599350 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-e6ad9e3d-e957-40b2-ae1d-6afdf86319c2 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:39.671305 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-e6ad9e3d-e957-40b2-ae1d-6afdf86319c2 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:39.681566 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-e6ad9e3d-e957-40b2-ae1d-6afdf86319c2 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094" status: 200 len: 1241 microversion: 2.1 time: 0.087608 Aug 31 09:57:39.682416 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 400/815] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:39 2022] GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094 => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:57:40.708019 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-d1c36918-bb5f-4762-9504-20af7a016d01 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:40.708634 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-d1c36918-bb5f-4762-9504-20af7a016d01 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:40.715813 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d1c36918-bb5f-4762-9504-20af7a016d01 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:40.716827 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d1c36918-bb5f-4762-9504-20af7a016d01 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:40.717640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d1c36918-bb5f-4762-9504-20af7a016d01 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:40.719640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d1c36918-bb5f-4762-9504-20af7a016d01 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:40.720219 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d1c36918-bb5f-4762-9504-20af7a016d01 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:40.720667 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d1c36918-bb5f-4762-9504-20af7a016d01 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:40.799756 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-d1c36918-bb5f-4762-9504-20af7a016d01 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:40.812124 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-d1c36918-bb5f-4762-9504-20af7a016d01 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094" status: 200 len: 1293 microversion: 2.1 time: 0.108919 Aug 31 09:57:40.813109 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 416/816] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:40 2022] GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094 => generated 1293 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:41.839399 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c54a8288-d8f9-4ef4-a264-4100af024203 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:41.840023 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c54a8288-d8f9-4ef4-a264-4100af024203 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:41.847559 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c54a8288-d8f9-4ef4-a264-4100af024203 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:41.848045 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c54a8288-d8f9-4ef4-a264-4100af024203 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:41.848474 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c54a8288-d8f9-4ef4-a264-4100af024203 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:41.849179 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c54a8288-d8f9-4ef4-a264-4100af024203 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:41.849657 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c54a8288-d8f9-4ef4-a264-4100af024203 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:41.850085 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c54a8288-d8f9-4ef4-a264-4100af024203 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:42.080494 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c54a8288-d8f9-4ef4-a264-4100af024203 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:42.099307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c54a8288-d8f9-4ef4-a264-4100af024203 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094" status: 200 len: 1367 microversion: 2.1 time: 0.263498 Aug 31 09:57:42.100860 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 401/817] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:41 2022] GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094 => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:42.741768 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-9f7c535e-9631-4546-a15b-1022546dffdf req-840f5611-a250-490c-af8b-592e31800223 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e42a48f-9abd-449f-8f42-f91ce8b40094", "tag": "b9a004e1-e2d5-4351-9de6-8cf4a7822bc5"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:57:42.760170 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-9f7c535e-9631-4546-a15b-1022546dffdf req-840f5611-a250-490c-af8b-592e31800223 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:42.760662 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-9f7c535e-9631-4546-a15b-1022546dffdf req-840f5611-a250-490c-af8b-592e31800223 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:42.761316 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-9f7c535e-9631-4546-a15b-1022546dffdf req-840f5611-a250-490c-af8b-592e31800223 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:42.776388 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-9f7c535e-9631-4546-a15b-1022546dffdf req-840f5611-a250-490c-af8b-592e31800223 service nova] Creating event network-changed:b9a004e1-e2d5-4351-9de6-8cf4a7822bc5 for instance 4e42a48f-9abd-449f-8f42-f91ce8b40094 on hv-cinder-84496 Aug 31 09:57:42.782014 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-9f7c535e-9631-4546-a15b-1022546dffdf req-840f5611-a250-490c-af8b-592e31800223 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045644 Aug 31 09:57:42.782809 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 417/818] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:57:43.137027 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-772a5daf-e30a-4356-b135-f3de5ab2d546 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:43.138196 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-772a5daf-e30a-4356-b135-f3de5ab2d546 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:43.151281 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-772a5daf-e30a-4356-b135-f3de5ab2d546 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:43.152162 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-772a5daf-e30a-4356-b135-f3de5ab2d546 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:43.152945 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-772a5daf-e30a-4356-b135-f3de5ab2d546 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:43.154133 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-772a5daf-e30a-4356-b135-f3de5ab2d546 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:43.154962 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-772a5daf-e30a-4356-b135-f3de5ab2d546 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:43.155745 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-772a5daf-e30a-4356-b135-f3de5ab2d546 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:43.372187 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-772a5daf-e30a-4356-b135-f3de5ab2d546 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:43.381062 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-772a5daf-e30a-4356-b135-f3de5ab2d546 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094" status: 200 len: 1367 microversion: 2.1 time: 0.248682 Aug 31 09:57:43.381714 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 402/819] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:43 2022] GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:44.403105 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-73bdeec5-47ba-4d4c-a73e-0a7fa0ab2be3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:44.403804 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-73bdeec5-47ba-4d4c-a73e-0a7fa0ab2be3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:44.410831 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-73bdeec5-47ba-4d4c-a73e-0a7fa0ab2be3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:44.411311 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-73bdeec5-47ba-4d4c-a73e-0a7fa0ab2be3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:44.411736 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-73bdeec5-47ba-4d4c-a73e-0a7fa0ab2be3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:44.412437 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-73bdeec5-47ba-4d4c-a73e-0a7fa0ab2be3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:44.412906 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-73bdeec5-47ba-4d4c-a73e-0a7fa0ab2be3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:44.413480 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-73bdeec5-47ba-4d4c-a73e-0a7fa0ab2be3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:44.556026 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-73bdeec5-47ba-4d4c-a73e-0a7fa0ab2be3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:44.563667 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-73bdeec5-47ba-4d4c-a73e-0a7fa0ab2be3 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094" status: 200 len: 1367 microversion: 2.1 time: 0.165286 Aug 31 09:57:44.564237 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 418/820] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:44 2022] GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:45.585406 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-6b9f96a5-767c-45c4-b8a3-217c85b87bb1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:45.586156 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-6b9f96a5-767c-45c4-b8a3-217c85b87bb1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:45.595928 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6b9f96a5-767c-45c4-b8a3-217c85b87bb1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:45.596937 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6b9f96a5-767c-45c4-b8a3-217c85b87bb1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:45.597364 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6b9f96a5-767c-45c4-b8a3-217c85b87bb1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:45.598489 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6b9f96a5-767c-45c4-b8a3-217c85b87bb1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:45.599097 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6b9f96a5-767c-45c4-b8a3-217c85b87bb1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:45.599575 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6b9f96a5-767c-45c4-b8a3-217c85b87bb1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:45.745266 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-6b9f96a5-767c-45c4-b8a3-217c85b87bb1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:45.754517 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-6b9f96a5-767c-45c4-b8a3-217c85b87bb1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094" status: 200 len: 1367 microversion: 2.1 time: 0.173737 Aug 31 09:57:45.755128 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 403/821] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:45 2022] GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:46.780415 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-00e13aac-d555-42cb-944a-569924608d6e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:46.781033 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-00e13aac-d555-42cb-944a-569924608d6e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:46.788574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-00e13aac-d555-42cb-944a-569924608d6e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:46.789064 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-00e13aac-d555-42cb-944a-569924608d6e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:46.789530 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-00e13aac-d555-42cb-944a-569924608d6e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:46.790239 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-00e13aac-d555-42cb-944a-569924608d6e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:46.790687 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-00e13aac-d555-42cb-944a-569924608d6e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:46.791108 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-00e13aac-d555-42cb-944a-569924608d6e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:46.945785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-00e13aac-d555-42cb-944a-569924608d6e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:46.953633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-00e13aac-d555-42cb-944a-569924608d6e tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094" status: 200 len: 1367 microversion: 2.1 time: 0.177158 Aug 31 09:57:46.954214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 419/822] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:46 2022] GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:47.975110 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-5ecdf8d6-bc15-4af0-8ee6-d7fe6b5154d6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:47.975714 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-5ecdf8d6-bc15-4af0-8ee6-d7fe6b5154d6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:47.982495 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5ecdf8d6-bc15-4af0-8ee6-d7fe6b5154d6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:47.982990 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5ecdf8d6-bc15-4af0-8ee6-d7fe6b5154d6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:47.983447 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5ecdf8d6-bc15-4af0-8ee6-d7fe6b5154d6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:47.984149 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5ecdf8d6-bc15-4af0-8ee6-d7fe6b5154d6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:47.984600 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5ecdf8d6-bc15-4af0-8ee6-d7fe6b5154d6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:47.985021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5ecdf8d6-bc15-4af0-8ee6-d7fe6b5154d6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:48.172116 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-5ecdf8d6-bc15-4af0-8ee6-d7fe6b5154d6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:48.180538 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-5ecdf8d6-bc15-4af0-8ee6-d7fe6b5154d6 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094" status: 200 len: 1367 microversion: 2.1 time: 0.209472 Aug 31 09:57:48.181153 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 404/823] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:47 2022] GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:49.201935 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-6d80dcdb-a79b-44b7-8f43-8cf54cb82d14 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:49.202539 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-6d80dcdb-a79b-44b7-8f43-8cf54cb82d14 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:49.204938 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:49.211663 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6d80dcdb-a79b-44b7-8f43-8cf54cb82d14 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:49.212304 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6d80dcdb-a79b-44b7-8f43-8cf54cb82d14 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:49.212736 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6d80dcdb-a79b-44b7-8f43-8cf54cb82d14 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:49.213561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6d80dcdb-a79b-44b7-8f43-8cf54cb82d14 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:49.214052 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6d80dcdb-a79b-44b7-8f43-8cf54cb82d14 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:49.214464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6d80dcdb-a79b-44b7-8f43-8cf54cb82d14 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:49.217522 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=65 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:49.406595 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-6d80dcdb-a79b-44b7-8f43-8cf54cb82d14 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:49.417567 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-6d80dcdb-a79b-44b7-8f43-8cf54cb82d14 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094" status: 200 len: 1367 microversion: 2.1 time: 0.219185 Aug 31 09:57:49.418122 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 420/824] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:49 2022] GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:49.873539 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-686182e0-ee7e-4163-98ef-e2c46147383c req-3e7e1dfa-50e4-4e49-aedb-4b30f3272d45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e42a48f-9abd-449f-8f42-f91ce8b40094", "name": "network-vif-plugged", "status": "completed", "tag": "b9a004e1-e2d5-4351-9de6-8cf4a7822bc5"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:57:49.880030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=6 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:49.886284 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-686182e0-ee7e-4163-98ef-e2c46147383c req-3e7e1dfa-50e4-4e49-aedb-4b30f3272d45 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:49.886763 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-686182e0-ee7e-4163-98ef-e2c46147383c req-3e7e1dfa-50e4-4e49-aedb-4b30f3272d45 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:49.887186 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-686182e0-ee7e-4163-98ef-e2c46147383c req-3e7e1dfa-50e4-4e49-aedb-4b30f3272d45 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:49.899406 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-686182e0-ee7e-4163-98ef-e2c46147383c req-3e7e1dfa-50e4-4e49-aedb-4b30f3272d45 service nova] Creating event network-vif-plugged:b9a004e1-e2d5-4351-9de6-8cf4a7822bc5 for instance 4e42a48f-9abd-449f-8f42-f91ce8b40094 on hv-cinder-84496 Aug 31 09:57:49.904453 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-686182e0-ee7e-4163-98ef-e2c46147383c req-3e7e1dfa-50e4-4e49-aedb-4b30f3272d45 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034781 Aug 31 09:57:49.905055 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 405/825] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:57:50.438829 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-0a0e7c69-da4c-48a6-a0b0-c455bcc53c4f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:50.439434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-0a0e7c69-da4c-48a6-a0b0-c455bcc53c4f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:50.442259 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=2 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:50.443401 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=6 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:50.450816 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0a0e7c69-da4c-48a6-a0b0-c455bcc53c4f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:50.451412 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0a0e7c69-da4c-48a6-a0b0-c455bcc53c4f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:50.451936 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0a0e7c69-da4c-48a6-a0b0-c455bcc53c4f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:50.452724 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0a0e7c69-da4c-48a6-a0b0-c455bcc53c4f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:50.453261 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0a0e7c69-da4c-48a6-a0b0-c455bcc53c4f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:50.453802 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0a0e7c69-da4c-48a6-a0b0-c455bcc53c4f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:50.591263 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-0a0e7c69-da4c-48a6-a0b0-c455bcc53c4f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:50.599274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-0a0e7c69-da4c-48a6-a0b0-c455bcc53c4f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094" status: 200 len: 1367 microversion: 2.1 time: 0.164268 Aug 31 09:57:50.599854 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 421/826] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:50 2022] GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:51.622358 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c178ad2e-8290-4177-a004-e2189bd4931a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:51.623077 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c178ad2e-8290-4177-a004-e2189bd4931a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:51.624986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:51.630652 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c178ad2e-8290-4177-a004-e2189bd4931a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:51.631161 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c178ad2e-8290-4177-a004-e2189bd4931a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:51.631596 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c178ad2e-8290-4177-a004-e2189bd4931a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:51.632321 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c178ad2e-8290-4177-a004-e2189bd4931a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:51.632982 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c178ad2e-8290-4177-a004-e2189bd4931a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:51.633579 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c178ad2e-8290-4177-a004-e2189bd4931a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:51.637475 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:51.781492 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c178ad2e-8290-4177-a004-e2189bd4931a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:51.790258 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c178ad2e-8290-4177-a004-e2189bd4931a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094" status: 200 len: 1367 microversion: 2.1 time: 0.172632 Aug 31 09:57:51.790858 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 406/827] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:51 2022] GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:52.812220 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-98210d24-4e03-471c-8924-eda6df4fa232 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:52.812793 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-98210d24-4e03-471c-8924-eda6df4fa232 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:52.819123 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-98210d24-4e03-471c-8924-eda6df4fa232 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:52.819595 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-98210d24-4e03-471c-8924-eda6df4fa232 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:52.820021 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-98210d24-4e03-471c-8924-eda6df4fa232 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:52.820697 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-98210d24-4e03-471c-8924-eda6df4fa232 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:52.821146 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-98210d24-4e03-471c-8924-eda6df4fa232 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:52.821592 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-98210d24-4e03-471c-8924-eda6df4fa232 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:52.955047 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-98210d24-4e03-471c-8924-eda6df4fa232 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:52.963486 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-98210d24-4e03-471c-8924-eda6df4fa232 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094" status: 200 len: 1557 microversion: 2.1 time: 0.155436 Aug 31 09:57:52.964059 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 422/828] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:52 2022] GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:52.984790 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-10b56a71-a620-49b3-8fd8-83dc9bb62bff tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:52.985319 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-10b56a71-a620-49b3-8fd8-83dc9bb62bff tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:52.992994 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-10b56a71-a620-49b3-8fd8-83dc9bb62bff tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:52.993506 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-10b56a71-a620-49b3-8fd8-83dc9bb62bff tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:52.993944 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-10b56a71-a620-49b3-8fd8-83dc9bb62bff tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:52.994641 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-10b56a71-a620-49b3-8fd8-83dc9bb62bff tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:52.995088 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-10b56a71-a620-49b3-8fd8-83dc9bb62bff tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:52.995506 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-10b56a71-a620-49b3-8fd8-83dc9bb62bff tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:53.076527 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-10b56a71-a620-49b3-8fd8-83dc9bb62bff tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095841 Aug 31 09:57:53.077115 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 407/829] 10.222.0.13 () {58 vars in 1275 bytes} [Wed Aug 31 09:57:52 2022] GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:57:54.031512 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-0ac91930-1da1-4fd0-8f39-8e2252e51a81 req-79c0210b-38e5-4b1a-9f3c-7618ad218fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e42a48f-9abd-449f-8f42-f91ce8b40094", "tag": "b9a004e1-e2d5-4351-9de6-8cf4a7822bc5"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:57:54.042387 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-0ac91930-1da1-4fd0-8f39-8e2252e51a81 req-79c0210b-38e5-4b1a-9f3c-7618ad218fc4 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:54.042857 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-0ac91930-1da1-4fd0-8f39-8e2252e51a81 req-79c0210b-38e5-4b1a-9f3c-7618ad218fc4 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:54.043284 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-0ac91930-1da1-4fd0-8f39-8e2252e51a81 req-79c0210b-38e5-4b1a-9f3c-7618ad218fc4 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:54.055479 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-0ac91930-1da1-4fd0-8f39-8e2252e51a81 req-79c0210b-38e5-4b1a-9f3c-7618ad218fc4 service nova] Creating event network-changed:b9a004e1-e2d5-4351-9de6-8cf4a7822bc5 for instance 4e42a48f-9abd-449f-8f42-f91ce8b40094 on hv-cinder-84496 Aug 31 09:57:54.060837 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-0ac91930-1da1-4fd0-8f39-8e2252e51a81 req-79c0210b-38e5-4b1a-9f3c-7618ad218fc4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032950 Aug 31 09:57:54.061473 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 423/830] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:00.134419 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-5c892691-8dd9-464d-b76e-66ba6d74f378 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:00.134963 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-5c892691-8dd9-464d-b76e-66ba6d74f378 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:00.140845 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5c892691-8dd9-464d-b76e-66ba6d74f378 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:00.141319 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5c892691-8dd9-464d-b76e-66ba6d74f378 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:00.141777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5c892691-8dd9-464d-b76e-66ba6d74f378 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:00.142461 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5c892691-8dd9-464d-b76e-66ba6d74f378 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:00.143558 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5c892691-8dd9-464d-b76e-66ba6d74f378 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:00.143980 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5c892691-8dd9-464d-b76e-66ba6d74f378 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:00.166861 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-5c892691-8dd9-464d-b76e-66ba6d74f378 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794/ips" status: 200 len: 146 microversion: 2.1 time: 0.036917 Aug 31 09:58:00.167431 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 408/831] 10.222.0.13 () {58 vars in 1248 bytes} [Wed Aug 31 09:58:00 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:01.503048 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-1e3d8092-f632-4772-b471-98a81cb4b6ce tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "297f96d5-bd99-4df4-9807-1440c61bf8f2"}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:58:01.505925 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-1e3d8092-f632-4772-b471-98a81cb4b6ce tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:01.512957 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1e3d8092-f632-4772-b471-98a81cb4b6ce tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:01.513468 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1e3d8092-f632-4772-b471-98a81cb4b6ce tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:01.513904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1e3d8092-f632-4772-b471-98a81cb4b6ce tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:01.514611 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1e3d8092-f632-4772-b471-98a81cb4b6ce tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:01.515067 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1e3d8092-f632-4772-b471-98a81cb4b6ce tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:01.515492 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1e3d8092-f632-4772-b471-98a81cb4b6ce tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:01.825190 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-1e3d8092-f632-4772-b471-98a81cb4b6ce tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "POST /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326411 Aug 31 09:58:01.825998 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 424/832] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 31 09:58:01 2022] POST /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:01.833811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-b43db6ad-1e2f-4f41-b2f5-72d84195fd42 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:01.834741 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-b43db6ad-1e2f-4f41-b2f5-72d84195fd42 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:01.851792 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b43db6ad-1e2f-4f41-b2f5-72d84195fd42 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:01.852462 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b43db6ad-1e2f-4f41-b2f5-72d84195fd42 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:01.853000 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b43db6ad-1e2f-4f41-b2f5-72d84195fd42 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:01.853811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b43db6ad-1e2f-4f41-b2f5-72d84195fd42 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:01.854657 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b43db6ad-1e2f-4f41-b2f5-72d84195fd42 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:01.856025 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b43db6ad-1e2f-4f41-b2f5-72d84195fd42 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:01.884402 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-b43db6ad-1e2f-4f41-b2f5-72d84195fd42 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9/ips" status: 200 len: 153 microversion: 2.20 time: 0.055725 Aug 31 09:58:01.885108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 409/833] 10.222.0.13 () {60 vars in 1289 bytes} [Wed Aug 31 09:58:01 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9/ips => generated 153 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:58:03.789340 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-cb4fc7fd-594d-495d-95b1-b70b11357333 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:58:03.789979 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-cb4fc7fd-594d-495d-95b1-b70b11357333 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:03.796942 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb4fc7fd-594d-495d-95b1-b70b11357333 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:03.797448 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb4fc7fd-594d-495d-95b1-b70b11357333 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:03.797864 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb4fc7fd-594d-495d-95b1-b70b11357333 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:03.798555 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb4fc7fd-594d-495d-95b1-b70b11357333 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:03.799002 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb4fc7fd-594d-495d-95b1-b70b11357333 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:03.799413 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb4fc7fd-594d-495d-95b1-b70b11357333 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:03.823226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.objects.instance [None req-cb4fc7fd-594d-495d-95b1-b70b11357333 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lazy-loading 'flavor' on Instance uuid b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 {{(pid=127170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:58:04.038003 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-cb4fc7fd-594d-495d-95b1-b70b11357333 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "POST /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9/action" status: 202 len: 0 microversion: 2.20 time: 0.253443 Aug 31 09:58:04.038705 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 425/834] 10.222.0.13 () {62 vars in 1319 bytes} [Wed Aug 31 09:58:03 2022] POST /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:58:04.048204 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-0ce187f6-ca18-47c8-83d5-6936a61f4d23 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:04.048996 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-0ce187f6-ca18-47c8-83d5-6936a61f4d23 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:04.057281 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0ce187f6-ca18-47c8-83d5-6936a61f4d23 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:04.057889 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0ce187f6-ca18-47c8-83d5-6936a61f4d23 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:04.059394 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0ce187f6-ca18-47c8-83d5-6936a61f4d23 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:04.060706 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0ce187f6-ca18-47c8-83d5-6936a61f4d23 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:04.061140 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0ce187f6-ca18-47c8-83d5-6936a61f4d23 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:04.061591 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0ce187f6-ca18-47c8-83d5-6936a61f4d23 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:04.215277 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-0ce187f6-ca18-47c8-83d5-6936a61f4d23 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:04.225455 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-0ce187f6-ca18-47c8-83d5-6936a61f4d23 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:04.226900 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-0ce187f6-ca18-47c8-83d5-6936a61f4d23 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:04.228090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-0ce187f6-ca18-47c8-83d5-6936a61f4d23 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1725 microversion: 2.20 time: 0.184298 Aug 31 09:58:04.228656 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 410/835] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:04 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:05.253647 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-8524b7d9-ef1a-4156-8b5d-5ed215c4f430 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:05.254607 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-8524b7d9-ef1a-4156-8b5d-5ed215c4f430 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:05.261819 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8524b7d9-ef1a-4156-8b5d-5ed215c4f430 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:05.262296 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8524b7d9-ef1a-4156-8b5d-5ed215c4f430 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:05.262720 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8524b7d9-ef1a-4156-8b5d-5ed215c4f430 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:05.263405 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8524b7d9-ef1a-4156-8b5d-5ed215c4f430 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:05.263847 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8524b7d9-ef1a-4156-8b5d-5ed215c4f430 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:05.264260 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8524b7d9-ef1a-4156-8b5d-5ed215c4f430 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:05.402137 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-8524b7d9-ef1a-4156-8b5d-5ed215c4f430 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:05.410275 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-8524b7d9-ef1a-4156-8b5d-5ed215c4f430 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:05.412946 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-8524b7d9-ef1a-4156-8b5d-5ed215c4f430 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:05.414192 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-8524b7d9-ef1a-4156-8b5d-5ed215c4f430 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1725 microversion: 2.20 time: 0.165949 Aug 31 09:58:05.414757 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 426/836] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:05 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:06.437281 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9e343948-014b-42ee-932e-260935e14766 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:06.437912 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-9e343948-014b-42ee-932e-260935e14766 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:06.445327 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9e343948-014b-42ee-932e-260935e14766 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:06.445831 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9e343948-014b-42ee-932e-260935e14766 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:06.446265 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9e343948-014b-42ee-932e-260935e14766 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:06.446959 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9e343948-014b-42ee-932e-260935e14766 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:06.447405 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9e343948-014b-42ee-932e-260935e14766 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:06.447823 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9e343948-014b-42ee-932e-260935e14766 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:06.576364 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-9e343948-014b-42ee-932e-260935e14766 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:06.586160 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-9e343948-014b-42ee-932e-260935e14766 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:06.587594 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-9e343948-014b-42ee-932e-260935e14766 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:06.588754 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-9e343948-014b-42ee-932e-260935e14766 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1725 microversion: 2.20 time: 0.155426 Aug 31 09:58:06.589308 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 411/837] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:06 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:07.611853 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-5652ffed-5519-4b6b-9a8d-76a129568d14 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:07.612450 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-5652ffed-5519-4b6b-9a8d-76a129568d14 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:07.619741 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5652ffed-5519-4b6b-9a8d-76a129568d14 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:07.620225 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5652ffed-5519-4b6b-9a8d-76a129568d14 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:07.620636 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5652ffed-5519-4b6b-9a8d-76a129568d14 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:07.621309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5652ffed-5519-4b6b-9a8d-76a129568d14 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:07.621770 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5652ffed-5519-4b6b-9a8d-76a129568d14 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:07.622183 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5652ffed-5519-4b6b-9a8d-76a129568d14 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:07.764010 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-5652ffed-5519-4b6b-9a8d-76a129568d14 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:07.773402 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-5652ffed-5519-4b6b-9a8d-76a129568d14 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:07.774766 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-5652ffed-5519-4b6b-9a8d-76a129568d14 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:07.776102 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-5652ffed-5519-4b6b-9a8d-76a129568d14 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1725 microversion: 2.20 time: 0.168019 Aug 31 09:58:07.776466 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 427/838] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:07 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:08.799739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-0ec70836-2eca-4e7c-86d9-d3643f3b53e7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:08.800341 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-0ec70836-2eca-4e7c-86d9-d3643f3b53e7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:08.807323 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0ec70836-2eca-4e7c-86d9-d3643f3b53e7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:08.807802 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0ec70836-2eca-4e7c-86d9-d3643f3b53e7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:08.808229 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0ec70836-2eca-4e7c-86d9-d3643f3b53e7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:08.808905 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0ec70836-2eca-4e7c-86d9-d3643f3b53e7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:08.809347 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0ec70836-2eca-4e7c-86d9-d3643f3b53e7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:08.809789 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0ec70836-2eca-4e7c-86d9-d3643f3b53e7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:08.938809 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-0ec70836-2eca-4e7c-86d9-d3643f3b53e7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:08.947517 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-0ec70836-2eca-4e7c-86d9-d3643f3b53e7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:08.948944 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-0ec70836-2eca-4e7c-86d9-d3643f3b53e7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:08.950132 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-0ec70836-2eca-4e7c-86d9-d3643f3b53e7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1725 microversion: 2.20 time: 0.154343 Aug 31 09:58:08.950685 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 412/839] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:08 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:09.973867 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-3c196875-be0c-4229-8c0a-35eae2f56dea tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:09.974458 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-3c196875-be0c-4229-8c0a-35eae2f56dea tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:09.980896 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3c196875-be0c-4229-8c0a-35eae2f56dea tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:09.981366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3c196875-be0c-4229-8c0a-35eae2f56dea tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:09.981821 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3c196875-be0c-4229-8c0a-35eae2f56dea tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:09.982506 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3c196875-be0c-4229-8c0a-35eae2f56dea tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:09.982954 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3c196875-be0c-4229-8c0a-35eae2f56dea tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:09.983364 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3c196875-be0c-4229-8c0a-35eae2f56dea tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:10.118169 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-3c196875-be0c-4229-8c0a-35eae2f56dea tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:10.126434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-3c196875-be0c-4229-8c0a-35eae2f56dea tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:10.127911 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-3c196875-be0c-4229-8c0a-35eae2f56dea tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:10.129070 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-3c196875-be0c-4229-8c0a-35eae2f56dea tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1725 microversion: 2.20 time: 0.159915 Aug 31 09:58:10.129742 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 428/840] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:09 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:10.456654 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-84e02b67-90d4-4b4a-a458-9d68a1b23d98 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:10.458925 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-84e02b67-90d4-4b4a-a458-9d68a1b23d98 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:10.465332 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-84e02b67-90d4-4b4a-a458-9d68a1b23d98 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:10.465840 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-84e02b67-90d4-4b4a-a458-9d68a1b23d98 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:10.466270 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-84e02b67-90d4-4b4a-a458-9d68a1b23d98 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:10.466947 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-84e02b67-90d4-4b4a-a458-9d68a1b23d98 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:10.467395 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-84e02b67-90d4-4b4a-a458-9d68a1b23d98 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:10.467802 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-84e02b67-90d4-4b4a-a458-9d68a1b23d98 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:10.499507 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-84e02b67-90d4-4b4a-a458-9d68a1b23d98 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046660 Aug 31 09:58:10.500061 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 413/841] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 31 09:58:10 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:10.510784 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-e06a031c-c303-4afe-9bea-ebc0a80fe643 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:10.511276 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-e06a031c-c303-4afe-9bea-ebc0a80fe643 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:10.517179 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e06a031c-c303-4afe-9bea-ebc0a80fe643 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:10.517698 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e06a031c-c303-4afe-9bea-ebc0a80fe643 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:10.518128 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e06a031c-c303-4afe-9bea-ebc0a80fe643 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:10.518814 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e06a031c-c303-4afe-9bea-ebc0a80fe643 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:10.519283 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e06a031c-c303-4afe-9bea-ebc0a80fe643 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:10.519708 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e06a031c-c303-4afe-9bea-ebc0a80fe643 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:10.550824 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-e06a031c-c303-4afe-9bea-ebc0a80fe643 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794/os-volume_attachments/297f96d5-bd99-4df4-9807-1440c61bf8f2" status: 200 len: 194 microversion: 2.1 time: 0.043850 Aug 31 09:58:10.552538 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 429/842] 10.222.0.13 () {58 vars in 1413 bytes} [Wed Aug 31 09:58:10 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794/os-volume_attachments/297f96d5-bd99-4df4-9807-1440c61bf8f2 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:58:11.152424 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-0d6217e3-0700-40b2-8fdf-689824da2951 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:11.152928 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-0d6217e3-0700-40b2-8fdf-689824da2951 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:11.158832 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0d6217e3-0700-40b2-8fdf-689824da2951 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:11.159311 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0d6217e3-0700-40b2-8fdf-689824da2951 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:11.159743 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0d6217e3-0700-40b2-8fdf-689824da2951 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:11.160935 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0d6217e3-0700-40b2-8fdf-689824da2951 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:11.161405 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0d6217e3-0700-40b2-8fdf-689824da2951 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:11.161831 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0d6217e3-0700-40b2-8fdf-689824da2951 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:11.293811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-0d6217e3-0700-40b2-8fdf-689824da2951 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:11.302404 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-0d6217e3-0700-40b2-8fdf-689824da2951 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:11.303877 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-0d6217e3-0700-40b2-8fdf-689824da2951 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:11.305053 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-0d6217e3-0700-40b2-8fdf-689824da2951 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1725 microversion: 2.20 time: 0.156946 Aug 31 09:58:11.305639 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 414/843] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:11 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:11.890959 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-7699c48a-16a8-4f30-bfa5-6c50fc1ae594 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "875a6ab0-9a98-4cac-91db-ed6a7db69f97"}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:58:11.893696 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-7699c48a-16a8-4f30-bfa5-6c50fc1ae594 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:11.902209 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7699c48a-16a8-4f30-bfa5-6c50fc1ae594 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:11.902686 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7699c48a-16a8-4f30-bfa5-6c50fc1ae594 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:11.903181 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7699c48a-16a8-4f30-bfa5-6c50fc1ae594 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:11.903878 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7699c48a-16a8-4f30-bfa5-6c50fc1ae594 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:11.904323 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7699c48a-16a8-4f30-bfa5-6c50fc1ae594 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:11.904738 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7699c48a-16a8-4f30-bfa5-6c50fc1ae594 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:12.185084 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-7699c48a-16a8-4f30-bfa5-6c50fc1ae594 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "POST /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298279 Aug 31 09:58:12.186097 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 430/844] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 31 09:58:11 2022] POST /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:12.327914 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-4f907acf-16f1-4326-bc85-41cab50b3c4f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:12.328516 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-4f907acf-16f1-4326-bc85-41cab50b3c4f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:12.335725 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4f907acf-16f1-4326-bc85-41cab50b3c4f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:12.336134 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4f907acf-16f1-4326-bc85-41cab50b3c4f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:12.336559 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4f907acf-16f1-4326-bc85-41cab50b3c4f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:12.337241 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4f907acf-16f1-4326-bc85-41cab50b3c4f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:12.337710 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4f907acf-16f1-4326-bc85-41cab50b3c4f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:12.338126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4f907acf-16f1-4326-bc85-41cab50b3c4f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:12.480919 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-4f907acf-16f1-4326-bc85-41cab50b3c4f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:12.489360 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-4f907acf-16f1-4326-bc85-41cab50b3c4f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:12.490929 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-4f907acf-16f1-4326-bc85-41cab50b3c4f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:12.491993 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-4f907acf-16f1-4326-bc85-41cab50b3c4f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1725 microversion: 2.20 time: 0.167909 Aug 31 09:58:12.492558 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 415/845] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:12 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:13.517406 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-5fa25184-f5f5-4f23-8c19-afc6b35eca7a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:13.518019 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-5fa25184-f5f5-4f23-8c19-afc6b35eca7a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:13.525589 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5fa25184-f5f5-4f23-8c19-afc6b35eca7a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:13.526076 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5fa25184-f5f5-4f23-8c19-afc6b35eca7a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:13.526508 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5fa25184-f5f5-4f23-8c19-afc6b35eca7a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:13.527204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5fa25184-f5f5-4f23-8c19-afc6b35eca7a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:13.527654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5fa25184-f5f5-4f23-8c19-afc6b35eca7a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:13.528072 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5fa25184-f5f5-4f23-8c19-afc6b35eca7a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:13.663187 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-5fa25184-f5f5-4f23-8c19-afc6b35eca7a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:13.671221 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-5fa25184-f5f5-4f23-8c19-afc6b35eca7a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:13.672635 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-5fa25184-f5f5-4f23-8c19-afc6b35eca7a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:13.673814 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-5fa25184-f5f5-4f23-8c19-afc6b35eca7a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1725 microversion: 2.20 time: 0.160817 Aug 31 09:58:13.674391 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 431/846] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:13 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:14.698336 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-455460d2-a088-44a7-a799-aaffe520864f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:14.699332 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-455460d2-a088-44a7-a799-aaffe520864f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:14.706170 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-455460d2-a088-44a7-a799-aaffe520864f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:14.706649 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-455460d2-a088-44a7-a799-aaffe520864f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:14.707082 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-455460d2-a088-44a7-a799-aaffe520864f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:14.708390 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-455460d2-a088-44a7-a799-aaffe520864f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:14.708843 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-455460d2-a088-44a7-a799-aaffe520864f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:14.709297 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-455460d2-a088-44a7-a799-aaffe520864f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:14.841756 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-455460d2-a088-44a7-a799-aaffe520864f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:14.851572 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-455460d2-a088-44a7-a799-aaffe520864f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:14.853044 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-455460d2-a088-44a7-a799-aaffe520864f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:14.854302 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-455460d2-a088-44a7-a799-aaffe520864f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1725 microversion: 2.20 time: 0.159860 Aug 31 09:58:14.854903 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 416/847] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:14 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:15.877549 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-11c6dc7f-4bf2-4ab2-aed6-46d1f659446f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:15.878182 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-11c6dc7f-4bf2-4ab2-aed6-46d1f659446f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:15.884662 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-11c6dc7f-4bf2-4ab2-aed6-46d1f659446f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:15.885130 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-11c6dc7f-4bf2-4ab2-aed6-46d1f659446f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:15.885593 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-11c6dc7f-4bf2-4ab2-aed6-46d1f659446f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:15.886268 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-11c6dc7f-4bf2-4ab2-aed6-46d1f659446f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:15.886709 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-11c6dc7f-4bf2-4ab2-aed6-46d1f659446f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:15.887151 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-11c6dc7f-4bf2-4ab2-aed6-46d1f659446f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:16.022644 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-11c6dc7f-4bf2-4ab2-aed6-46d1f659446f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:16.024952 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:16.033371 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-11c6dc7f-4bf2-4ab2-aed6-46d1f659446f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:16.034837 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-11c6dc7f-4bf2-4ab2-aed6-46d1f659446f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:16.036931 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-11c6dc7f-4bf2-4ab2-aed6-46d1f659446f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1746 microversion: 2.20 time: 0.163240 Aug 31 09:58:16.037631 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 432/848] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:15 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1746 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:17.060171 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-b735fbd0-1391-4e71-bccf-26ebaa72a8d5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:17.060775 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-b735fbd0-1391-4e71-bccf-26ebaa72a8d5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:17.068243 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b735fbd0-1391-4e71-bccf-26ebaa72a8d5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:17.068739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b735fbd0-1391-4e71-bccf-26ebaa72a8d5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:17.069176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b735fbd0-1391-4e71-bccf-26ebaa72a8d5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:17.069898 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b735fbd0-1391-4e71-bccf-26ebaa72a8d5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:17.070349 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b735fbd0-1391-4e71-bccf-26ebaa72a8d5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:17.070771 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b735fbd0-1391-4e71-bccf-26ebaa72a8d5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:17.205740 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b735fbd0-1391-4e71-bccf-26ebaa72a8d5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:17.214536 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b735fbd0-1391-4e71-bccf-26ebaa72a8d5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:17.215969 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b735fbd0-1391-4e71-bccf-26ebaa72a8d5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:17.217117 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-b735fbd0-1391-4e71-bccf-26ebaa72a8d5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1746 microversion: 2.20 time: 0.160860 Aug 31 09:58:17.217711 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 417/849] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:17 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:18.240569 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-30c60d52-2252-4379-be5f-49d0e4f6cd40 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:18.241146 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-30c60d52-2252-4379-be5f-49d0e4f6cd40 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:18.248666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-30c60d52-2252-4379-be5f-49d0e4f6cd40 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:18.249139 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-30c60d52-2252-4379-be5f-49d0e4f6cd40 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:18.249596 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-30c60d52-2252-4379-be5f-49d0e4f6cd40 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:18.250275 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-30c60d52-2252-4379-be5f-49d0e4f6cd40 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:18.250714 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-30c60d52-2252-4379-be5f-49d0e4f6cd40 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:18.251127 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-30c60d52-2252-4379-be5f-49d0e4f6cd40 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:18.386680 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-30c60d52-2252-4379-be5f-49d0e4f6cd40 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:18.395797 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-30c60d52-2252-4379-be5f-49d0e4f6cd40 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:18.397242 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-30c60d52-2252-4379-be5f-49d0e4f6cd40 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:18.398521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-30c60d52-2252-4379-be5f-49d0e4f6cd40 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1746 microversion: 2.20 time: 0.162784 Aug 31 09:58:18.399079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 433/850] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:18 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:19.422539 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-6a0d9958-747f-46dd-b848-71b81c08c5fd tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:19.423275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-6a0d9958-747f-46dd-b848-71b81c08c5fd tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:19.430530 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6a0d9958-747f-46dd-b848-71b81c08c5fd tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:19.431080 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6a0d9958-747f-46dd-b848-71b81c08c5fd tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:19.431452 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6a0d9958-747f-46dd-b848-71b81c08c5fd tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:19.432154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6a0d9958-747f-46dd-b848-71b81c08c5fd tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:19.432601 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6a0d9958-747f-46dd-b848-71b81c08c5fd tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:19.433015 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6a0d9958-747f-46dd-b848-71b81c08c5fd tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:19.572069 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-6a0d9958-747f-46dd-b848-71b81c08c5fd tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:19.582171 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-6a0d9958-747f-46dd-b848-71b81c08c5fd tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:19.583784 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-6a0d9958-747f-46dd-b848-71b81c08c5fd tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:19.584960 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-6a0d9958-747f-46dd-b848-71b81c08c5fd tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1746 microversion: 2.20 time: 0.166406 Aug 31 09:58:19.585540 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 418/851] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:19 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1746 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:20.059094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-84cea67b-dbdc-4cf6-84fe-192612d523d4 req-a26fd99a-7cf6-44e4-8ad5-046be2c6047a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9", "name": "network-vif-plugged", "status": "completed", "tag": "f0ab5d21-97ec-4a21-a75b-253b40f65e47"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:58:20.064446 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=28 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:20.086079 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-84cea67b-dbdc-4cf6-84fe-192612d523d4 req-a26fd99a-7cf6-44e4-8ad5-046be2c6047a service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:20.086961 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-84cea67b-dbdc-4cf6-84fe-192612d523d4 req-a26fd99a-7cf6-44e4-8ad5-046be2c6047a service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:20.087387 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-84cea67b-dbdc-4cf6-84fe-192612d523d4 req-a26fd99a-7cf6-44e4-8ad5-046be2c6047a service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:20.100964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-84cea67b-dbdc-4cf6-84fe-192612d523d4 req-a26fd99a-7cf6-44e4-8ad5-046be2c6047a service nova] Creating event network-vif-plugged:f0ab5d21-97ec-4a21-a75b-253b40f65e47 for instance b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 on hv-cinder-84496 Aug 31 09:58:20.107592 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-84cea67b-dbdc-4cf6-84fe-192612d523d4 req-a26fd99a-7cf6-44e4-8ad5-046be2c6047a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051879 Aug 31 09:58:20.108234 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 434/852] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:20.608067 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-5f26da28-5d04-4972-83fb-21c411e8da2c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:20.608656 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-5f26da28-5d04-4972-83fb-21c411e8da2c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:20.616171 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5f26da28-5d04-4972-83fb-21c411e8da2c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:20.616646 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5f26da28-5d04-4972-83fb-21c411e8da2c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:20.617076 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5f26da28-5d04-4972-83fb-21c411e8da2c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:20.617783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5f26da28-5d04-4972-83fb-21c411e8da2c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:20.618226 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5f26da28-5d04-4972-83fb-21c411e8da2c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:20.618643 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5f26da28-5d04-4972-83fb-21c411e8da2c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:20.755906 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-5f26da28-5d04-4972-83fb-21c411e8da2c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:20.764137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-5f26da28-5d04-4972-83fb-21c411e8da2c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:20.765609 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-5f26da28-5d04-4972-83fb-21c411e8da2c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:20.766783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-5f26da28-5d04-4972-83fb-21c411e8da2c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1746 microversion: 2.20 time: 0.162643 Aug 31 09:58:20.767343 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 419/853] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:20 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:20.798964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-173ed660-cd54-4cf5-82b3-038908b4f7c2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:20.801792 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-173ed660-cd54-4cf5-82b3-038908b4f7c2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:20.808012 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-173ed660-cd54-4cf5-82b3-038908b4f7c2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:20.808495 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-173ed660-cd54-4cf5-82b3-038908b4f7c2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:20.808924 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-173ed660-cd54-4cf5-82b3-038908b4f7c2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:20.809656 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-173ed660-cd54-4cf5-82b3-038908b4f7c2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:20.810121 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-173ed660-cd54-4cf5-82b3-038908b4f7c2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:20.810534 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-173ed660-cd54-4cf5-82b3-038908b4f7c2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:20.840090 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-173ed660-cd54-4cf5-82b3-038908b4f7c2 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045491 Aug 31 09:58:20.840655 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 435/854] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 31 09:58:20 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:20.980890 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-b8642033-28ce-4a39-9230-5707b266c547 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:20.981401 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-b8642033-28ce-4a39-9230-5707b266c547 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:20.987399 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b8642033-28ce-4a39-9230-5707b266c547 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:20.987886 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b8642033-28ce-4a39-9230-5707b266c547 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:20.988961 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b8642033-28ce-4a39-9230-5707b266c547 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:20.990177 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b8642033-28ce-4a39-9230-5707b266c547 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:20.990695 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b8642033-28ce-4a39-9230-5707b266c547 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:20.991124 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b8642033-28ce-4a39-9230-5707b266c547 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:21.022506 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-b8642033-28ce-4a39-9230-5707b266c547 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794/os-volume_attachments/297f96d5-bd99-4df4-9807-1440c61bf8f2" status: 200 len: 194 microversion: 2.1 time: 0.047158 Aug 31 09:58:21.023102 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 420/855] 10.222.0.13 () {58 vars in 1413 bytes} [Wed Aug 31 09:58:20 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794/os-volume_attachments/297f96d5-bd99-4df4-9807-1440c61bf8f2 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:21.033173 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-25e207f8-6d16-4d5b-afae-8ce013cafb3b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:21.033701 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-25e207f8-6d16-4d5b-afae-8ce013cafb3b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:21.040225 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-25e207f8-6d16-4d5b-afae-8ce013cafb3b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:21.040698 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-25e207f8-6d16-4d5b-afae-8ce013cafb3b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:21.041124 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-25e207f8-6d16-4d5b-afae-8ce013cafb3b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:21.041842 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-25e207f8-6d16-4d5b-afae-8ce013cafb3b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:21.042287 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-25e207f8-6d16-4d5b-afae-8ce013cafb3b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:21.042697 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-25e207f8-6d16-4d5b-afae-8ce013cafb3b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:21.126006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.objects.instance [None req-25e207f8-6d16-4d5b-afae-8ce013cafb3b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lazy-loading 'services' on Instance uuid dad5a844-b1e2-4310-919c-7d3a334cc794 {{(pid=127170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:58:21.199367 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-25e207f8-6d16-4d5b-afae-8ce013cafb3b tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794/os-volume_attachments/297f96d5-bd99-4df4-9807-1440c61bf8f2" status: 202 len: 0 microversion: 2.1 time: 0.169862 Aug 31 09:58:21.199953 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 436/856] 10.222.0.13 () {58 vars in 1416 bytes} [Wed Aug 31 09:58:21 2022] DELETE /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794/os-volume_attachments/297f96d5-bd99-4df4-9807-1440c61bf8f2 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:58:21.791192 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-1882316e-1d4f-4bf3-b6a3-c1a0fc33b325 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:21.791798 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-1882316e-1d4f-4bf3-b6a3-c1a0fc33b325 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:21.794160 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=30 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:21.800152 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1882316e-1d4f-4bf3-b6a3-c1a0fc33b325 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:21.800644 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1882316e-1d4f-4bf3-b6a3-c1a0fc33b325 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:21.802147 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1882316e-1d4f-4bf3-b6a3-c1a0fc33b325 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:21.803043 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1882316e-1d4f-4bf3-b6a3-c1a0fc33b325 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:21.803498 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1882316e-1d4f-4bf3-b6a3-c1a0fc33b325 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:21.803943 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1882316e-1d4f-4bf3-b6a3-c1a0fc33b325 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:21.807066 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=84 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:21.946342 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-1882316e-1d4f-4bf3-b6a3-c1a0fc33b325 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:21.954630 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-1882316e-1d4f-4bf3-b6a3-c1a0fc33b325 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:21.956067 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-1882316e-1d4f-4bf3-b6a3-c1a0fc33b325 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:21.957900 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-1882316e-1d4f-4bf3-b6a3-c1a0fc33b325 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1746 microversion: 2.20 time: 0.170038 Aug 31 09:58:21.958850 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 421/857] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:21 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1746 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:22.984563 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-d8d30264-9e53-476d-a103-c3e927dc350c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:22.985337 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-d8d30264-9e53-476d-a103-c3e927dc350c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:22.993598 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d8d30264-9e53-476d-a103-c3e927dc350c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:22.994029 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d8d30264-9e53-476d-a103-c3e927dc350c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:22.994457 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d8d30264-9e53-476d-a103-c3e927dc350c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:22.995150 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d8d30264-9e53-476d-a103-c3e927dc350c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:22.995590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d8d30264-9e53-476d-a103-c3e927dc350c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:22.996001 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d8d30264-9e53-476d-a103-c3e927dc350c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:23.140078 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-d8d30264-9e53-476d-a103-c3e927dc350c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:23.149553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-d8d30264-9e53-476d-a103-c3e927dc350c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:23.150974 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-d8d30264-9e53-476d-a103-c3e927dc350c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:23.152143 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-d8d30264-9e53-476d-a103-c3e927dc350c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1741 microversion: 2.20 time: 0.172779 Aug 31 09:58:23.152700 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 437/858] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:22 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:23.395369 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9e656685-8ce0-41ba-92ca-331f193a1148 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:23.396007 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-9e656685-8ce0-41ba-92ca-331f193a1148 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:23.403891 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9e656685-8ce0-41ba-92ca-331f193a1148 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:23.404823 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9e656685-8ce0-41ba-92ca-331f193a1148 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:23.404823 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9e656685-8ce0-41ba-92ca-331f193a1148 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:23.405512 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9e656685-8ce0-41ba-92ca-331f193a1148 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:23.405956 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9e656685-8ce0-41ba-92ca-331f193a1148 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:23.406371 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9e656685-8ce0-41ba-92ca-331f193a1148 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:23.442851 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-9e656685-8ce0-41ba-92ca-331f193a1148 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794/os-volume_attachments/875a6ab0-9a98-4cac-91db-ed6a7db69f97" status: 200 len: 194 microversion: 2.1 time: 0.051172 Aug 31 09:58:23.443296 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 422/859] 10.222.0.13 () {58 vars in 1413 bytes} [Wed Aug 31 09:58:23 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794/os-volume_attachments/875a6ab0-9a98-4cac-91db-ed6a7db69f97 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:58:23.454487 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-9d977208-ca39-430b-b25c-3ec4d6026b2a tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:23.455117 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-9d977208-ca39-430b-b25c-3ec4d6026b2a tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:23.462157 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9d977208-ca39-430b-b25c-3ec4d6026b2a tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:23.462725 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9d977208-ca39-430b-b25c-3ec4d6026b2a tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:23.463227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9d977208-ca39-430b-b25c-3ec4d6026b2a tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:23.463991 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9d977208-ca39-430b-b25c-3ec4d6026b2a tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:23.464517 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9d977208-ca39-430b-b25c-3ec4d6026b2a tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:23.465008 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9d977208-ca39-430b-b25c-3ec4d6026b2a tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:23.561645 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.objects.instance [None req-9d977208-ca39-430b-b25c-3ec4d6026b2a tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lazy-loading 'services' on Instance uuid dad5a844-b1e2-4310-919c-7d3a334cc794 {{(pid=127170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:58:23.667217 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-9d977208-ca39-430b-b25c-3ec4d6026b2a tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794/os-volume_attachments/875a6ab0-9a98-4cac-91db-ed6a7db69f97" status: 202 len: 0 microversion: 2.1 time: 0.216524 Aug 31 09:58:23.668100 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 438/860] 10.222.0.13 () {58 vars in 1416 bytes} [Wed Aug 31 09:58:23 2022] DELETE /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794/os-volume_attachments/875a6ab0-9a98-4cac-91db-ed6a7db69f97 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:58:24.176265 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-7ed1cabe-ff68-41d3-9736-d3face252db2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:24.177291 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-7ed1cabe-ff68-41d3-9736-d3face252db2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:24.190206 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7ed1cabe-ff68-41d3-9736-d3face252db2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:24.191189 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7ed1cabe-ff68-41d3-9736-d3face252db2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:24.191792 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7ed1cabe-ff68-41d3-9736-d3face252db2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:24.193214 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7ed1cabe-ff68-41d3-9736-d3face252db2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:24.194210 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7ed1cabe-ff68-41d3-9736-d3face252db2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:24.195066 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7ed1cabe-ff68-41d3-9736-d3face252db2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:24.491062 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7ed1cabe-ff68-41d3-9736-d3face252db2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:24.503917 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7ed1cabe-ff68-41d3-9736-d3face252db2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:24.507253 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7ed1cabe-ff68-41d3-9736-d3face252db2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:24.508729 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-7ed1cabe-ff68-41d3-9736-d3face252db2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1741 microversion: 2.20 time: 0.336424 Aug 31 09:58:24.509421 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 423/861] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:24 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1741 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:58:24.969112 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b068d490-5d44-4a34-96ca-d6b488f88d3c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:24.977321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b068d490-5d44-4a34-96ca-d6b488f88d3c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:24.984460 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b068d490-5d44-4a34-96ca-d6b488f88d3c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:24.985165 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b068d490-5d44-4a34-96ca-d6b488f88d3c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:24.986022 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b068d490-5d44-4a34-96ca-d6b488f88d3c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:24.987285 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b068d490-5d44-4a34-96ca-d6b488f88d3c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:24.988050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b068d490-5d44-4a34-96ca-d6b488f88d3c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:24.989413 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b068d490-5d44-4a34-96ca-d6b488f88d3c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:25.030684 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b068d490-5d44-4a34-96ca-d6b488f88d3c tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068878 Aug 31 09:58:25.032363 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 439/862] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 31 09:58:24 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 09:58:25.186264 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-94e5d3c9-f4aa-4a7b-95c6-7d8ccdaf9aeb tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:25.188880 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-94e5d3c9-f4aa-4a7b-95c6-7d8ccdaf9aeb tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:25.198699 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-94e5d3c9-f4aa-4a7b-95c6-7d8ccdaf9aeb tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:25.199488 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-94e5d3c9-f4aa-4a7b-95c6-7d8ccdaf9aeb tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:25.200216 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-94e5d3c9-f4aa-4a7b-95c6-7d8ccdaf9aeb tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:25.201416 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-94e5d3c9-f4aa-4a7b-95c6-7d8ccdaf9aeb tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:25.202171 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-94e5d3c9-f4aa-4a7b-95c6-7d8ccdaf9aeb tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:25.202603 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-94e5d3c9-f4aa-4a7b-95c6-7d8ccdaf9aeb tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:25.236753 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-94e5d3c9-f4aa-4a7b-95c6-7d8ccdaf9aeb tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054393 Aug 31 09:58:25.237945 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 424/863] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 31 09:58:25 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 09:58:25.315351 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-5bf79b93-da05-445d-a719-917063088b32 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:25.315838 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-5bf79b93-da05-445d-a719-917063088b32 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:25.322547 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5bf79b93-da05-445d-a719-917063088b32 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:25.323248 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5bf79b93-da05-445d-a719-917063088b32 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:25.323851 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5bf79b93-da05-445d-a719-917063088b32 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:25.324778 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5bf79b93-da05-445d-a719-917063088b32 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:25.325301 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5bf79b93-da05-445d-a719-917063088b32 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:25.326031 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5bf79b93-da05-445d-a719-917063088b32 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:25.355899 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-5bf79b93-da05-445d-a719-917063088b32 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Going to try to terminate instance {{(pid=127170) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:58:25.447842 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-5bf79b93-da05-445d-a719-917063088b32 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 204 len: 0 microversion: 2.1 time: 0.136088 Aug 31 09:58:25.449464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 440/864] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 09:58:25 2022] DELETE /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:58:25.457674 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-66964b80-58cb-491b-af19-df964d77a402 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:25.458367 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-66964b80-58cb-491b-af19-df964d77a402 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:25.465321 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-66964b80-58cb-491b-af19-df964d77a402 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:25.466017 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-66964b80-58cb-491b-af19-df964d77a402 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:25.466510 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-66964b80-58cb-491b-af19-df964d77a402 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:25.467323 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-66964b80-58cb-491b-af19-df964d77a402 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:25.467848 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-66964b80-58cb-491b-af19-df964d77a402 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:25.468271 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-66964b80-58cb-491b-af19-df964d77a402 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:25.533322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-540a9bdb-28ef-4dda-9518-b87f74816929 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:25.534078 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-540a9bdb-28ef-4dda-9518-b87f74816929 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:25.542006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-540a9bdb-28ef-4dda-9518-b87f74816929 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:25.542539 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-540a9bdb-28ef-4dda-9518-b87f74816929 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:25.542974 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-540a9bdb-28ef-4dda-9518-b87f74816929 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:25.544303 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-540a9bdb-28ef-4dda-9518-b87f74816929 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:25.544434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-540a9bdb-28ef-4dda-9518-b87f74816929 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:25.544818 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-540a9bdb-28ef-4dda-9518-b87f74816929 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:25.652325 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-66964b80-58cb-491b-af19-df964d77a402 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:25.662653 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-66964b80-58cb-491b-af19-df964d77a402 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 200 len: 1673 microversion: 2.1 time: 0.208597 Aug 31 09:58:25.664072 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 425/865] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:25 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 1673 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:25.731366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-540a9bdb-28ef-4dda-9518-b87f74816929 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:25.740394 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-540a9bdb-28ef-4dda-9518-b87f74816929 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:25.741869 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-540a9bdb-28ef-4dda-9518-b87f74816929 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:25.743060 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-540a9bdb-28ef-4dda-9518-b87f74816929 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1741 microversion: 2.20 time: 0.214568 Aug 31 09:58:25.754571 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 441/866] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:25 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1741 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:58:26.690127 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-710c638f-b3c9-42bf-8bf6-f8e0c6810674 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:26.691254 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-710c638f-b3c9-42bf-8bf6-f8e0c6810674 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:26.702893 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-710c638f-b3c9-42bf-8bf6-f8e0c6810674 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:26.703518 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-710c638f-b3c9-42bf-8bf6-f8e0c6810674 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:26.704029 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-710c638f-b3c9-42bf-8bf6-f8e0c6810674 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:26.704734 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-710c638f-b3c9-42bf-8bf6-f8e0c6810674 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:26.705226 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-710c638f-b3c9-42bf-8bf6-f8e0c6810674 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:26.705677 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-710c638f-b3c9-42bf-8bf6-f8e0c6810674 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:26.766961 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-871daccc-ae5b-4a46-87be-01dfd828a922 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:26.768397 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-871daccc-ae5b-4a46-87be-01dfd828a922 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:26.779778 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-871daccc-ae5b-4a46-87be-01dfd828a922 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:26.780332 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-871daccc-ae5b-4a46-87be-01dfd828a922 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:26.780873 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-871daccc-ae5b-4a46-87be-01dfd828a922 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:26.781850 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-871daccc-ae5b-4a46-87be-01dfd828a922 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:26.782431 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-871daccc-ae5b-4a46-87be-01dfd828a922 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:26.782967 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-871daccc-ae5b-4a46-87be-01dfd828a922 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:26.914306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-710c638f-b3c9-42bf-8bf6-f8e0c6810674 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:26.924834 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-710c638f-b3c9-42bf-8bf6-f8e0c6810674 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 200 len: 1673 microversion: 2.1 time: 0.243452 Aug 31 09:58:26.926538 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 426/867] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:26 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 1673 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:26.969998 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-871daccc-ae5b-4a46-87be-01dfd828a922 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:26.980528 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-871daccc-ae5b-4a46-87be-01dfd828a922 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:26.982006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-871daccc-ae5b-4a46-87be-01dfd828a922 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:26.983169 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-871daccc-ae5b-4a46-87be-01dfd828a922 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1741 microversion: 2.20 time: 0.220799 Aug 31 09:58:26.983726 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 442/868] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:26 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1741 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:27.951533 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-2e16ab31-5ec5-47a4-a322-5f448d1e3352 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:27.952146 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-2e16ab31-5ec5-47a4-a322-5f448d1e3352 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:27.959394 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2e16ab31-5ec5-47a4-a322-5f448d1e3352 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:27.960415 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2e16ab31-5ec5-47a4-a322-5f448d1e3352 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:27.960857 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2e16ab31-5ec5-47a4-a322-5f448d1e3352 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:27.961591 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2e16ab31-5ec5-47a4-a322-5f448d1e3352 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:27.962044 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2e16ab31-5ec5-47a4-a322-5f448d1e3352 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:27.962465 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2e16ab31-5ec5-47a4-a322-5f448d1e3352 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:28.008435 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-443be757-59a4-42c0-a386-d185a7da55ef tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:28.009143 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-443be757-59a4-42c0-a386-d185a7da55ef tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:28.023859 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-443be757-59a4-42c0-a386-d185a7da55ef tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:28.024511 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-443be757-59a4-42c0-a386-d185a7da55ef tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:28.025193 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-443be757-59a4-42c0-a386-d185a7da55ef tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:28.026138 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-443be757-59a4-42c0-a386-d185a7da55ef tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:28.026999 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-443be757-59a4-42c0-a386-d185a7da55ef tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:28.027620 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-443be757-59a4-42c0-a386-d185a7da55ef tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:28.352911 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2e16ab31-5ec5-47a4-a322-5f448d1e3352 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:28.362685 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-2e16ab31-5ec5-47a4-a322-5f448d1e3352 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 200 len: 1673 microversion: 2.1 time: 0.414939 Aug 31 09:58:28.363670 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 427/869] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:27 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 1673 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:28.391233 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-443be757-59a4-42c0-a386-d185a7da55ef tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:28.401682 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-443be757-59a4-42c0-a386-d185a7da55ef tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:28.403111 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-443be757-59a4-42c0-a386-d185a7da55ef tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:28.404277 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-443be757-59a4-42c0-a386-d185a7da55ef tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1741 microversion: 2.20 time: 0.400435 Aug 31 09:58:28.405818 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 443/870] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:28 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1741 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:29.107014 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-b7715720-6d55-457a-a2a0-38e779fbc0f0 req-48ff17b8-c47a-4ba9-9db1-bcf36862a165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dad5a844-b1e2-4310-919c-7d3a334cc794", "name": "network-vif-deleted", "tag": "faf14e51-3e45-4bef-906c-896093d3aeda"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:58:29.122934 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-b7715720-6d55-457a-a2a0-38e779fbc0f0 req-48ff17b8-c47a-4ba9-9db1-bcf36862a165 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:29.123793 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-b7715720-6d55-457a-a2a0-38e779fbc0f0 req-48ff17b8-c47a-4ba9-9db1-bcf36862a165 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:29.124444 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-b7715720-6d55-457a-a2a0-38e779fbc0f0 req-48ff17b8-c47a-4ba9-9db1-bcf36862a165 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:29.139119 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-b7715720-6d55-457a-a2a0-38e779fbc0f0 req-48ff17b8-c47a-4ba9-9db1-bcf36862a165 service nova] Creating event network-vif-deleted:faf14e51-3e45-4bef-906c-896093d3aeda for instance dad5a844-b1e2-4310-919c-7d3a334cc794 on hv-cinder-84496 Aug 31 09:58:29.144970 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-b7715720-6d55-457a-a2a0-38e779fbc0f0 req-48ff17b8-c47a-4ba9-9db1-bcf36862a165 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041569 Aug 31 09:58:29.149911 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 428/871] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:29.387134 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-84667989-9fda-45fa-8bd6-37773584e535 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:29.388323 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-84667989-9fda-45fa-8bd6-37773584e535 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:29.397153 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-84667989-9fda-45fa-8bd6-37773584e535 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:29.397939 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-84667989-9fda-45fa-8bd6-37773584e535 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:29.398625 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-84667989-9fda-45fa-8bd6-37773584e535 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:29.399556 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-84667989-9fda-45fa-8bd6-37773584e535 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:29.400238 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-84667989-9fda-45fa-8bd6-37773584e535 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:29.400962 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-84667989-9fda-45fa-8bd6-37773584e535 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:29.430248 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-d76e292a-faf9-4aa5-807c-fd9bac8254f9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:29.431350 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-d76e292a-faf9-4aa5-807c-fd9bac8254f9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:29.452910 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d76e292a-faf9-4aa5-807c-fd9bac8254f9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:29.454034 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d76e292a-faf9-4aa5-807c-fd9bac8254f9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:29.455802 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d76e292a-faf9-4aa5-807c-fd9bac8254f9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:29.458551 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d76e292a-faf9-4aa5-807c-fd9bac8254f9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:29.460956 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d76e292a-faf9-4aa5-807c-fd9bac8254f9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:29.465176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d76e292a-faf9-4aa5-807c-fd9bac8254f9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:29.503311 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-84667989-9fda-45fa-8bd6-37773584e535 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:29.505321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-84667989-9fda-45fa-8bd6-37773584e535 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:29.506252 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-84667989-9fda-45fa-8bd6-37773584e535 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:29.506953 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.objects.instance [None req-84667989-9fda-45fa-8bd6-37773584e535 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lazy-loading 'fault' on Instance uuid dad5a844-b1e2-4310-919c-7d3a334cc794 {{(pid=127170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:58:29.621987 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-84667989-9fda-45fa-8bd6-37773584e535 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4961545b43f74fdb87d01b78600d54ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05be916a558445ee8550559d491efbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:29.635223 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-84667989-9fda-45fa-8bd6-37773584e535 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 200 len: 1326 microversion: 2.1 time: 0.255142 Aug 31 09:58:29.636447 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 444/872] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:29 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 1326 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:58:29.736583 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-d76e292a-faf9-4aa5-807c-fd9bac8254f9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:29.746466 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-d76e292a-faf9-4aa5-807c-fd9bac8254f9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:29.759263 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-d76e292a-faf9-4aa5-807c-fd9bac8254f9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:29.760612 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-d76e292a-faf9-4aa5-807c-fd9bac8254f9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1741 microversion: 2.20 time: 0.336199 Aug 31 09:58:29.761566 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 429/873] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:29 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1741 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:30.660819 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-49a86d7e-c6e7-49e4-b6a6-0d5f6abe39a8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:30.664859 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-49a86d7e-c6e7-49e4-b6a6-0d5f6abe39a8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:30.674291 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-49a86d7e-c6e7-49e4-b6a6-0d5f6abe39a8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:30.675070 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-49a86d7e-c6e7-49e4-b6a6-0d5f6abe39a8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:30.677199 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-49a86d7e-c6e7-49e4-b6a6-0d5f6abe39a8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:30.679066 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-49a86d7e-c6e7-49e4-b6a6-0d5f6abe39a8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:30.680099 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-49a86d7e-c6e7-49e4-b6a6-0d5f6abe39a8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:30.680892 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-49a86d7e-c6e7-49e4-b6a6-0d5f6abe39a8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:30.704218 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-49a86d7e-c6e7-49e4-b6a6-0d5f6abe39a8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] HTTP exception thrown: Instance dad5a844-b1e2-4310-919c-7d3a334cc794 could not be found. Aug 31 09:58:30.706521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-49a86d7e-c6e7-49e4-b6a6-0d5f6abe39a8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Request method failure captured: Aug 31 09:58:30.706521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 HTTP/1.1 Aug 31 09:58:30.706521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 09:58:30.706521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 09:58:30.706521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 09:58:30.706521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 09:58:30.706521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 09:58:30.706521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 09:58:30.706521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 09:58:30.706521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 09:58:30.706521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy5See43u58u5EXG3loy4AhYMwy6YaTNJnReW9dKOgGiQKvfsTky41o7p2qc1PKgqh5R7FYZXO249sKPlNGgdXV3ksIpIJWoTxRv5osyE8ZAH_nq2Zvv0ydkq9Xy9kz5N6-QlrDPIwOFePyKBNTXxobLBAq5hsin8Q-HeKlXK1OF9yA Aug 31 09:58:30.706521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 09:58:30.706521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 09:58:30.706521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 09:58:30.706521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 09:58:30.706521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 09:58:30.706521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 09:58:30.706521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: 05be916a558445ee8550559d491efbd0 Aug 31 09:58:30.706521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-AttachVolumeTestJSON-1716048162 Aug 31 09:58:30.706521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 09:58:30.706521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 09:58:30.708893 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/05be916a558445ee8550559d491efbd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/05be916a558445ee8550559d491efbd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/05be916a558445ee8550559d491efbd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_05be916a558445ee8550559d491efbd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:58:30.708893 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-AttachVolumeTestJSON-1716048162 Aug 31 09:58:30.708893 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: 05be916a558445ee8550559d491efbd0 Aug 31 09:58:30.708893 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1716048162 Aug 31 09:58:30.708893 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-AttachVolumeTestJSON-1716048162-project Aug 31 09:58:30.708893 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 09:58:30.708893 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 09:58:30.708893 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: 4961545b43f74fdb87d01b78600d54ed Aug 31 09:58:30.708893 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-AttachVolumeTestJSON-1716048162-project Aug 31 09:58:30.708893 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 09:58:30.708893 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Instance dad5a844-b1e2-4310-919c-7d3a334cc794 could not be found. Aug 31 09:58:30.708893 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': 'dad5a844-b1e2-4310-919c-7d3a334cc794'} Aug 31 09:58:30.709844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:58:30.709844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:30.709844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:58:30.709844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:58:30.709844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:58:30.709844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:58:30.709844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:58:30.709844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:58:30.709844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:58:30.709844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:58:30.709844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dad5a844-b1e2-4310-919c-7d3a334cc794 could not be found. Aug 31 09:58:30.709844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:58:30.709844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:30.709844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:58:30.709844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:30.709844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:30.709844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:30.709844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:58:30.709844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:58:30.709844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:58:30.711352 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:58:30.711352 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:58:30.711352 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:58:30.711352 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:58:30.711352 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:58:30.711352 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:58:30.711352 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:58:30.711352 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dad5a844-b1e2-4310-919c-7d3a334cc794 could not be found. Aug 31 09:58:30.711352 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:58:30.711352 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:30.711352 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:58:30.711352 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:30.711352 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:30.711352 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:30.711352 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:58:30.711352 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:58:30.711352 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dad5a844-b1e2-4310-919c-7d3a334cc794 could not be found. Aug 31 09:58:30.711352 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:58:30.715461 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-49a86d7e-c6e7-49e4-b6a6-0d5f6abe39a8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Returning 404 to user: Instance dad5a844-b1e2-4310-919c-7d3a334cc794 could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:58:30.716752 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-49a86d7e-c6e7-49e4-b6a6-0d5f6abe39a8 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 404 len: 111 microversion: 2.1 time: 0.061734 Aug 31 09:58:30.717855 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 445/874] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:30 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:58:30.732399 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-ea33d21c-489c-4ce5-8552-6101cf5761a3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '.version_select at 0x7f5503cbc4c0>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:30.790741 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-1dcf1d30-7530-4556-a1a7-34d41e8d945b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:30.791578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-1dcf1d30-7530-4556-a1a7-34d41e8d945b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:30.796009 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-ea33d21c-489c-4ce5-8552-6101cf5761a3 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-262318595" status: 202 len: 0 microversion: 2.1 time: 0.071334 Aug 31 09:58:30.798716 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 430/875] 10.222.0.13 () {58 vars in 1218 bytes} [Wed Aug 31 09:58:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-262318595 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:58:30.802128 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1dcf1d30-7530-4556-a1a7-34d41e8d945b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:30.805148 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1dcf1d30-7530-4556-a1a7-34d41e8d945b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:30.806404 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1dcf1d30-7530-4556-a1a7-34d41e8d945b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:30.808060 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1dcf1d30-7530-4556-a1a7-34d41e8d945b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:30.814938 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1dcf1d30-7530-4556-a1a7-34d41e8d945b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:30.815705 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1dcf1d30-7530-4556-a1a7-34d41e8d945b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:31.093799 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-1dcf1d30-7530-4556-a1a7-34d41e8d945b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:31.104284 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-1dcf1d30-7530-4556-a1a7-34d41e8d945b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:31.107646 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-1dcf1d30-7530-4556-a1a7-34d41e8d945b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:31.109213 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-1dcf1d30-7530-4556-a1a7-34d41e8d945b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1741 microversion: 2.20 time: 0.326124 Aug 31 09:58:31.113802 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 446/876] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:30 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1741 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:58:32.138581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-38cc2791-2f2a-4a4c-82b6-afd7629eea66 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:32.140066 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-38cc2791-2f2a-4a4c-82b6-afd7629eea66 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:32.152663 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38cc2791-2f2a-4a4c-82b6-afd7629eea66 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:32.154378 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38cc2791-2f2a-4a4c-82b6-afd7629eea66 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:32.158261 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38cc2791-2f2a-4a4c-82b6-afd7629eea66 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:32.160372 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38cc2791-2f2a-4a4c-82b6-afd7629eea66 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:32.162876 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38cc2791-2f2a-4a4c-82b6-afd7629eea66 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:32.163505 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38cc2791-2f2a-4a4c-82b6-afd7629eea66 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:32.788354 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-38cc2791-2f2a-4a4c-82b6-afd7629eea66 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:32.803925 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-38cc2791-2f2a-4a4c-82b6-afd7629eea66 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:32.808011 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-38cc2791-2f2a-4a4c-82b6-afd7629eea66 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:32.809962 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-38cc2791-2f2a-4a4c-82b6-afd7629eea66 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1741 microversion: 2.20 time: 0.676540 Aug 31 09:58:32.810844 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 431/877] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:32 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1741 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:33.090877 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-d29ed344-8c03-4be7-911d-44cf0f8b06fa req-00aac851-c03d-4c20-aeec-3670bef51931 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b32c74c-ed7a-496f-bf84-ce2d50e8b808", "tag": "a4adc3c8-d787-4f05-8cd2-ace7305b75c0"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:58:33.098473 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a903b783-8c91-46d9-9960-959b97e57ed8 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:33.099251 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-a903b783-8c91-46d9-9960-959b97e57ed8 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:33.127597 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a903b783-8c91-46d9-9960-959b97e57ed8 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:33.128426 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a903b783-8c91-46d9-9960-959b97e57ed8 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:33.129224 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a903b783-8c91-46d9-9960-959b97e57ed8 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:33.139482 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a903b783-8c91-46d9-9960-959b97e57ed8 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:33.140310 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a903b783-8c91-46d9-9960-959b97e57ed8 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:33.141531 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a903b783-8c91-46d9-9960-959b97e57ed8 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:33.142134 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-d29ed344-8c03-4be7-911d-44cf0f8b06fa req-00aac851-c03d-4c20-aeec-3670bef51931 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:33.149250 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-d29ed344-8c03-4be7-911d-44cf0f8b06fa req-00aac851-c03d-4c20-aeec-3670bef51931 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:33.150182 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-d29ed344-8c03-4be7-911d-44cf0f8b06fa req-00aac851-c03d-4c20-aeec-3670bef51931 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:33.183843 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-d29ed344-8c03-4be7-911d-44cf0f8b06fa req-00aac851-c03d-4c20-aeec-3670bef51931 service nova] Creating event network-changed:a4adc3c8-d787-4f05-8cd2-ace7305b75c0 for instance 1b32c74c-ed7a-496f-bf84-ce2d50e8b808 on hv-cinder-84496 Aug 31 09:58:33.204365 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-d29ed344-8c03-4be7-911d-44cf0f8b06fa req-00aac851-c03d-4c20-aeec-3670bef51931 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124654 Aug 31 09:58:33.206412 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:33.207002 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 432/878] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:33.262873 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-a903b783-8c91-46d9-9960-959b97e57ed8 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Going to try to terminate instance {{(pid=127170) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:58:33.433743 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a903b783-8c91-46d9-9960-959b97e57ed8 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 204 len: 0 microversion: 2.1 time: 0.356851 Aug 31 09:58:33.435074 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 447/879] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 09:58:33 2022] DELETE /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:58:33.447989 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-499083cf-5b8c-4f2e-b5d1-8fb05c200ab7 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:33.448773 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-499083cf-5b8c-4f2e-b5d1-8fb05c200ab7 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:33.465558 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-499083cf-5b8c-4f2e-b5d1-8fb05c200ab7 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:33.467010 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-499083cf-5b8c-4f2e-b5d1-8fb05c200ab7 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:33.469349 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-499083cf-5b8c-4f2e-b5d1-8fb05c200ab7 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:33.471578 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-499083cf-5b8c-4f2e-b5d1-8fb05c200ab7 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:33.472852 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-499083cf-5b8c-4f2e-b5d1-8fb05c200ab7 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:33.473976 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-499083cf-5b8c-4f2e-b5d1-8fb05c200ab7 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:33.738450 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-499083cf-5b8c-4f2e-b5d1-8fb05c200ab7 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:33.752605 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-499083cf-5b8c-4f2e-b5d1-8fb05c200ab7 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1566 microversion: 2.1 time: 0.309888 Aug 31 09:58:33.756767 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 433/880] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:33 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1566 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:33.854782 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-cfd08676-827f-4eff-a86d-2ef880da6c4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:33.864575 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-cfd08676-827f-4eff-a86d-2ef880da6c4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:33.870182 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cfd08676-827f-4eff-a86d-2ef880da6c4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:33.870711 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cfd08676-827f-4eff-a86d-2ef880da6c4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:33.871590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cfd08676-827f-4eff-a86d-2ef880da6c4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:33.871852 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cfd08676-827f-4eff-a86d-2ef880da6c4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:33.874187 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cfd08676-827f-4eff-a86d-2ef880da6c4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:33.874187 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cfd08676-827f-4eff-a86d-2ef880da6c4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:34.068511 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-cfd08676-827f-4eff-a86d-2ef880da6c4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:34.082897 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-cfd08676-827f-4eff-a86d-2ef880da6c4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:34.084567 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-cfd08676-827f-4eff-a86d-2ef880da6c4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:34.085936 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-cfd08676-827f-4eff-a86d-2ef880da6c4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1741 microversion: 2.20 time: 0.237752 Aug 31 09:58:34.086510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 448/881] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:33 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1741 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:34.266633 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-59e9307a-db34-4d5b-ac09-8b439d6c8084 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:34.267765 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-59e9307a-db34-4d5b-ac09-8b439d6c8084 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:34.275852 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-59e9307a-db34-4d5b-ac09-8b439d6c8084 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:34.276635 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-59e9307a-db34-4d5b-ac09-8b439d6c8084 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:34.277141 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-59e9307a-db34-4d5b-ac09-8b439d6c8084 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:34.277897 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-59e9307a-db34-4d5b-ac09-8b439d6c8084 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:34.278351 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-59e9307a-db34-4d5b-ac09-8b439d6c8084 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:34.278814 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-59e9307a-db34-4d5b-ac09-8b439d6c8084 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:34.296043 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.wsgi [None req-59e9307a-db34-4d5b-ac09-8b439d6c8084 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] HTTP exception thrown: Instance dad5a844-b1e2-4310-919c-7d3a334cc794 could not be found. Aug 31 09:58:34.298307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-59e9307a-db34-4d5b-ac09-8b439d6c8084 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Request method failure captured: Aug 31 09:58:34.298307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: request: DELETE /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 HTTP/1.1 Aug 31 09:58:34.298307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept: application/json Aug 31 09:58:34.298307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept-Encoding: identity Aug 31 09:58:34.298307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Connection: close Aug 31 09:58:34.298307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Length: 0 Aug 31 09:58:34.298307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Type: application/json Aug 31 09:58:34.298307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Host: 10.222.0.13 Aug 31 09:58:34.298307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Openstack-System-Scope: None Aug 31 09:58:34.298307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: User-Agent: python-urllib3/1.26.12 Aug 31 09:58:34.298307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Auth-Token: gAAAAABjDy5See43u58u5EXG3loy4AhYMwy6YaTNJnReW9dKOgGiQKvfsTky41o7p2qc1PKgqh5R7FYZXO249sKPlNGgdXV3ksIpIJWoTxRv5osyE8ZAH_nq2Zvv0ydkq9Xy9kz5N6-QlrDPIwOFePyKBNTXxobLBAq5hsin8Q-HeKlXK1OF9yA Aug 31 09:58:34.298307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Id: None Aug 31 09:58:34.298307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Name: None Aug 31 09:58:34.298307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Identity-Status: Confirmed Aug 31 09:58:34.298307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Is-Admin-Project: True Aug 31 09:58:34.298307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Id: default Aug 31 09:58:34.298307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Name: Default Aug 31 09:58:34.298307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Id: 05be916a558445ee8550559d491efbd0 Aug 31 09:58:34.298307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Name: tempest-AttachVolumeTestJSON-1716048162 Aug 31 09:58:34.298307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Role: member,reader Aug 31 09:58:34.298307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Roles: member,reader Aug 31 09:58:34.299995 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/05be916a558445ee8550559d491efbd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/05be916a558445ee8550559d491efbd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/05be916a558445ee8550559d491efbd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_05be916a558445ee8550559d491efbd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:58:34.299995 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant: tempest-AttachVolumeTestJSON-1716048162 Aug 31 09:58:34.299995 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Id: 05be916a558445ee8550559d491efbd0 Aug 31 09:58:34.299995 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1716048162 Aug 31 09:58:34.299995 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User: tempest-AttachVolumeTestJSON-1716048162-project Aug 31 09:58:34.299995 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Id: default Aug 31 09:58:34.299995 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Name: Default Aug 31 09:58:34.299995 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Id: 4961545b43f74fdb87d01b78600d54ed Aug 31 09:58:34.299995 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Name: tempest-AttachVolumeTestJSON-1716048162-project Aug 31 09:58:34.299995 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: method: > Aug 31 09:58:34.299995 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: exception: Instance dad5a844-b1e2-4310-919c-7d3a334cc794 could not be found. Aug 31 09:58:34.299995 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: action_args: {'id': 'dad5a844-b1e2-4310-919c-7d3a334cc794'} Aug 31 09:58:34.301021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:58:34.301021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:34.301021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:58:34.301021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:58:34.301021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:58:34.301021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:58:34.301021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:58:34.301021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:58:34.301021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:58:34.301021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:58:34.301021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dad5a844-b1e2-4310-919c-7d3a334cc794 could not be found. Aug 31 09:58:34.301021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:58:34.301021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:34.301021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:58:34.301021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:34.301021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:34.301021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:34.301021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:58:34.301021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:58:34.301021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:58:34.302517 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:58:34.302517 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 09:58:34.302517 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 09:58:34.302517 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 09:58:34.302517 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 09:58:34.302517 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:58:34.302517 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:58:34.302517 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:58:34.302517 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:58:34.302517 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dad5a844-b1e2-4310-919c-7d3a334cc794 could not be found. Aug 31 09:58:34.302517 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:58:34.302517 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:34.302517 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:58:34.302517 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:34.302517 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:34.302517 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:34.302517 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:58:34.302517 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:58:34.302517 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dad5a844-b1e2-4310-919c-7d3a334cc794 could not be found. Aug 31 09:58:34.302517 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:58:34.304756 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-59e9307a-db34-4d5b-ac09-8b439d6c8084 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Returning 404 to user: Instance dad5a844-b1e2-4310-919c-7d3a334cc794 could not be found. {{(pid=127171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:58:34.305649 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-59e9307a-db34-4d5b-ac09-8b439d6c8084 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 404 len: 111 microversion: 2.1 time: 0.043314 Aug 31 09:58:34.306225 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 434/882] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 09:58:34 2022] DELETE /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:58:34.314771 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-c9be68f9-7bff-45e7-b598-0b44bf05b6bc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:34.315836 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-c9be68f9-7bff-45e7-b598-0b44bf05b6bc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: dad5a844-b1e2-4310-919c-7d3a334cc794] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:34.335691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c9be68f9-7bff-45e7-b598-0b44bf05b6bc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:34.336354 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c9be68f9-7bff-45e7-b598-0b44bf05b6bc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:34.336863 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c9be68f9-7bff-45e7-b598-0b44bf05b6bc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:34.337993 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c9be68f9-7bff-45e7-b598-0b44bf05b6bc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:34.338700 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c9be68f9-7bff-45e7-b598-0b44bf05b6bc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:34.339340 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c9be68f9-7bff-45e7-b598-0b44bf05b6bc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:34.362249 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-c9be68f9-7bff-45e7-b598-0b44bf05b6bc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] HTTP exception thrown: Instance dad5a844-b1e2-4310-919c-7d3a334cc794 could not be found. Aug 31 09:58:34.365214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-c9be68f9-7bff-45e7-b598-0b44bf05b6bc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Request method failure captured: Aug 31 09:58:34.365214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 HTTP/1.1 Aug 31 09:58:34.365214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 09:58:34.365214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 09:58:34.365214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 09:58:34.365214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 09:58:34.365214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 09:58:34.365214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 09:58:34.365214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 09:58:34.365214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 09:58:34.365214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy5See43u58u5EXG3loy4AhYMwy6YaTNJnReW9dKOgGiQKvfsTky41o7p2qc1PKgqh5R7FYZXO249sKPlNGgdXV3ksIpIJWoTxRv5osyE8ZAH_nq2Zvv0ydkq9Xy9kz5N6-QlrDPIwOFePyKBNTXxobLBAq5hsin8Q-HeKlXK1OF9yA Aug 31 09:58:34.365214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 09:58:34.365214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 09:58:34.365214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 09:58:34.365214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 09:58:34.365214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 09:58:34.365214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 09:58:34.365214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: 05be916a558445ee8550559d491efbd0 Aug 31 09:58:34.365214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-AttachVolumeTestJSON-1716048162 Aug 31 09:58:34.365214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 09:58:34.365214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 09:58:34.366714 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/05be916a558445ee8550559d491efbd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/05be916a558445ee8550559d491efbd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/05be916a558445ee8550559d491efbd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_05be916a558445ee8550559d491efbd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:58:34.366714 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-AttachVolumeTestJSON-1716048162 Aug 31 09:58:34.366714 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: 05be916a558445ee8550559d491efbd0 Aug 31 09:58:34.366714 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1716048162 Aug 31 09:58:34.366714 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-AttachVolumeTestJSON-1716048162-project Aug 31 09:58:34.366714 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 09:58:34.366714 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 09:58:34.366714 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: 4961545b43f74fdb87d01b78600d54ed Aug 31 09:58:34.366714 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-AttachVolumeTestJSON-1716048162-project Aug 31 09:58:34.366714 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 09:58:34.366714 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Instance dad5a844-b1e2-4310-919c-7d3a334cc794 could not be found. Aug 31 09:58:34.366714 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': 'dad5a844-b1e2-4310-919c-7d3a334cc794'} Aug 31 09:58:34.367465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:58:34.367465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:34.367465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:58:34.367465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:58:34.367465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:58:34.367465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:58:34.367465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:58:34.367465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:58:34.367465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:58:34.367465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:58:34.367465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dad5a844-b1e2-4310-919c-7d3a334cc794 could not be found. Aug 31 09:58:34.367465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:58:34.367465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:34.367465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:58:34.367465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:34.367465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:34.367465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:34.367465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:58:34.367465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:58:34.367465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:58:34.368671 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:58:34.368671 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:58:34.368671 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:58:34.368671 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:58:34.368671 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:58:34.368671 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:58:34.368671 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:58:34.368671 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dad5a844-b1e2-4310-919c-7d3a334cc794 could not be found. Aug 31 09:58:34.368671 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:58:34.368671 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:34.368671 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:58:34.368671 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:34.368671 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:34.368671 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:34.368671 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:58:34.368671 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:58:34.368671 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dad5a844-b1e2-4310-919c-7d3a334cc794 could not be found. Aug 31 09:58:34.368671 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:58:34.371532 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-c9be68f9-7bff-45e7-b598-0b44bf05b6bc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Returning 404 to user: Instance dad5a844-b1e2-4310-919c-7d3a334cc794 could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:58:34.372870 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-c9be68f9-7bff-45e7-b598-0b44bf05b6bc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794" status: 404 len: 111 microversion: 2.1 time: 0.062497 Aug 31 09:58:34.374043 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 449/883] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:34 2022] GET /compute/v2.1/servers/dad5a844-b1e2-4310-919c-7d3a334cc794 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:58:34.775813 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-7c5f58bb-8c98-4559-a3d9-84844ce6579b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:34.777145 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-7c5f58bb-8c98-4559-a3d9-84844ce6579b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:34.784292 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7c5f58bb-8c98-4559-a3d9-84844ce6579b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:34.785783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7c5f58bb-8c98-4559-a3d9-84844ce6579b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:34.786663 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7c5f58bb-8c98-4559-a3d9-84844ce6579b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:34.787851 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7c5f58bb-8c98-4559-a3d9-84844ce6579b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:34.788629 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7c5f58bb-8c98-4559-a3d9-84844ce6579b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:34.789217 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7c5f58bb-8c98-4559-a3d9-84844ce6579b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:35.022960 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7c5f58bb-8c98-4559-a3d9-84844ce6579b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:35.034388 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-7c5f58bb-8c98-4559-a3d9-84844ce6579b tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1566 microversion: 2.1 time: 0.262651 Aug 31 09:58:35.035823 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 435/884] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:34 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1566 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:35.111218 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-0919f638-2e0d-4fbf-93fe-71368eb81c58 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:35.111720 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-0919f638-2e0d-4fbf-93fe-71368eb81c58 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:35.119069 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0919f638-2e0d-4fbf-93fe-71368eb81c58 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:35.119548 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0919f638-2e0d-4fbf-93fe-71368eb81c58 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:35.120488 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0919f638-2e0d-4fbf-93fe-71368eb81c58 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:35.121017 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0919f638-2e0d-4fbf-93fe-71368eb81c58 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:35.121499 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0919f638-2e0d-4fbf-93fe-71368eb81c58 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:35.122173 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0919f638-2e0d-4fbf-93fe-71368eb81c58 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:35.330783 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-0919f638-2e0d-4fbf-93fe-71368eb81c58 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:35.339751 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-0919f638-2e0d-4fbf-93fe-71368eb81c58 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:35.341177 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-0919f638-2e0d-4fbf-93fe-71368eb81c58 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:35.342371 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-0919f638-2e0d-4fbf-93fe-71368eb81c58 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1741 microversion: 2.20 time: 0.235349 Aug 31 09:58:35.342939 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 450/885] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:35 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1741 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:58:35.585641 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-51135bcd-58e9-4e2e-b9a9-7c6530ad53bc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:35.586509 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-51135bcd-58e9-4e2e-b9a9-7c6530ad53bc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:35.593074 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-51135bcd-58e9-4e2e-b9a9-7c6530ad53bc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:35.593613 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-51135bcd-58e9-4e2e-b9a9-7c6530ad53bc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:35.594058 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-51135bcd-58e9-4e2e-b9a9-7c6530ad53bc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:35.594780 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-51135bcd-58e9-4e2e-b9a9-7c6530ad53bc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:35.595241 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-51135bcd-58e9-4e2e-b9a9-7c6530ad53bc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:35.595664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-51135bcd-58e9-4e2e-b9a9-7c6530ad53bc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:35.611576 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.wsgi [None req-51135bcd-58e9-4e2e-b9a9-7c6530ad53bc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] HTTP exception thrown: Instance e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 could not be found. Aug 31 09:58:35.615783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-51135bcd-58e9-4e2e-b9a9-7c6530ad53bc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Request method failure captured: Aug 31 09:58:35.615783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: request: DELETE /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 HTTP/1.1 Aug 31 09:58:35.615783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept: application/json Aug 31 09:58:35.615783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept-Encoding: identity Aug 31 09:58:35.615783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Connection: close Aug 31 09:58:35.615783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Length: 0 Aug 31 09:58:35.615783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Type: application/json Aug 31 09:58:35.615783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Host: 10.222.0.13 Aug 31 09:58:35.615783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Openstack-System-Scope: None Aug 31 09:58:35.615783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: User-Agent: python-urllib3/1.26.12 Aug 31 09:58:35.615783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Auth-Token: gAAAAABjDy5See43u58u5EXG3loy4AhYMwy6YaTNJnReW9dKOgGiQKvfsTky41o7p2qc1PKgqh5R7FYZXO249sKPlNGgdXV3ksIpIJWoTxRv5osyE8ZAH_nq2Zvv0ydkq9Xy9kz5N6-QlrDPIwOFePyKBNTXxobLBAq5hsin8Q-HeKlXK1OF9yA Aug 31 09:58:35.615783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Id: None Aug 31 09:58:35.615783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Name: None Aug 31 09:58:35.615783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Identity-Status: Confirmed Aug 31 09:58:35.615783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Is-Admin-Project: True Aug 31 09:58:35.615783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Id: default Aug 31 09:58:35.615783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Name: Default Aug 31 09:58:35.615783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Id: 05be916a558445ee8550559d491efbd0 Aug 31 09:58:35.615783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Name: tempest-AttachVolumeTestJSON-1716048162 Aug 31 09:58:35.615783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Role: member,reader Aug 31 09:58:35.615783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Roles: member,reader Aug 31 09:58:35.618688 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/05be916a558445ee8550559d491efbd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/05be916a558445ee8550559d491efbd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/05be916a558445ee8550559d491efbd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_05be916a558445ee8550559d491efbd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:58:35.618688 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant: tempest-AttachVolumeTestJSON-1716048162 Aug 31 09:58:35.618688 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Id: 05be916a558445ee8550559d491efbd0 Aug 31 09:58:35.618688 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1716048162 Aug 31 09:58:35.618688 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User: tempest-AttachVolumeTestJSON-1716048162-project Aug 31 09:58:35.618688 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Id: default Aug 31 09:58:35.618688 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Name: Default Aug 31 09:58:35.618688 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Id: 4961545b43f74fdb87d01b78600d54ed Aug 31 09:58:35.618688 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Name: tempest-AttachVolumeTestJSON-1716048162-project Aug 31 09:58:35.618688 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: method: > Aug 31 09:58:35.618688 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: exception: Instance e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 could not be found. Aug 31 09:58:35.618688 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: action_args: {'id': 'e598a8ab-5332-4c3c-8f72-098d0ac6a3c8'} Aug 31 09:58:35.623311 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:58:35.623311 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:35.623311 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:58:35.623311 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:58:35.623311 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:58:35.623311 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:58:35.623311 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:58:35.623311 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:58:35.623311 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:58:35.623311 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:58:35.623311 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 could not be found. Aug 31 09:58:35.623311 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:58:35.623311 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:35.623311 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:58:35.623311 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:35.623311 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:35.623311 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:35.623311 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:58:35.623311 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:58:35.623311 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:58:35.625933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:58:35.625933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 09:58:35.625933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 09:58:35.625933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 09:58:35.625933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 09:58:35.625933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:58:35.625933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:58:35.625933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:58:35.625933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:58:35.625933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 could not be found. Aug 31 09:58:35.625933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:58:35.625933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:35.625933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:58:35.625933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:35.625933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:35.625933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:35.625933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:58:35.625933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:58:35.625933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 could not be found. Aug 31 09:58:35.625933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:58:35.628469 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-51135bcd-58e9-4e2e-b9a9-7c6530ad53bc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Returning 404 to user: Instance e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 could not be found. {{(pid=127171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:58:35.628469 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-51135bcd-58e9-4e2e-b9a9-7c6530ad53bc tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 404 len: 111 microversion: 2.1 time: 0.037115 Aug 31 09:58:35.628469 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 436/886] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 09:58:35 2022] DELETE /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 09:58:35.633099 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-4bb108bf-d592-4010-b722-4beebbd10732 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:35.634187 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-4bb108bf-d592-4010-b722-4beebbd10732 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] [instance: e598a8ab-5332-4c3c-8f72-098d0ac6a3c8] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:35.645128 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4bb108bf-d592-4010-b722-4beebbd10732 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:35.646032 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4bb108bf-d592-4010-b722-4beebbd10732 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:35.646761 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4bb108bf-d592-4010-b722-4beebbd10732 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:35.647957 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4bb108bf-d592-4010-b722-4beebbd10732 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:35.648746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4bb108bf-d592-4010-b722-4beebbd10732 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:35.649316 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4bb108bf-d592-4010-b722-4beebbd10732 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:35.670683 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-4bb108bf-d592-4010-b722-4beebbd10732 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] HTTP exception thrown: Instance e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 could not be found. Aug 31 09:58:35.673262 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-4bb108bf-d592-4010-b722-4beebbd10732 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Request method failure captured: Aug 31 09:58:35.673262 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 HTTP/1.1 Aug 31 09:58:35.673262 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 09:58:35.673262 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 09:58:35.673262 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 09:58:35.673262 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 09:58:35.673262 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 09:58:35.673262 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 09:58:35.673262 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 09:58:35.673262 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 09:58:35.673262 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy5See43u58u5EXG3loy4AhYMwy6YaTNJnReW9dKOgGiQKvfsTky41o7p2qc1PKgqh5R7FYZXO249sKPlNGgdXV3ksIpIJWoTxRv5osyE8ZAH_nq2Zvv0ydkq9Xy9kz5N6-QlrDPIwOFePyKBNTXxobLBAq5hsin8Q-HeKlXK1OF9yA Aug 31 09:58:35.673262 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 09:58:35.673262 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 09:58:35.673262 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 09:58:35.673262 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 09:58:35.673262 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 09:58:35.673262 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 09:58:35.673262 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: 05be916a558445ee8550559d491efbd0 Aug 31 09:58:35.673262 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-AttachVolumeTestJSON-1716048162 Aug 31 09:58:35.673262 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 09:58:35.673262 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 09:58:35.674925 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/05be916a558445ee8550559d491efbd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/05be916a558445ee8550559d491efbd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/05be916a558445ee8550559d491efbd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_05be916a558445ee8550559d491efbd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:58:35.674925 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-AttachVolumeTestJSON-1716048162 Aug 31 09:58:35.674925 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: 05be916a558445ee8550559d491efbd0 Aug 31 09:58:35.674925 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1716048162 Aug 31 09:58:35.674925 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-AttachVolumeTestJSON-1716048162-project Aug 31 09:58:35.674925 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 09:58:35.674925 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 09:58:35.674925 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: 4961545b43f74fdb87d01b78600d54ed Aug 31 09:58:35.674925 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-AttachVolumeTestJSON-1716048162-project Aug 31 09:58:35.674925 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 09:58:35.674925 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Instance e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 could not be found. Aug 31 09:58:35.674925 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': 'e598a8ab-5332-4c3c-8f72-098d0ac6a3c8'} Aug 31 09:58:35.676365 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:58:35.676365 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:35.676365 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:58:35.676365 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:58:35.676365 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:58:35.676365 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:58:35.676365 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:58:35.676365 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:58:35.676365 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:58:35.676365 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:58:35.676365 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 could not be found. Aug 31 09:58:35.676365 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:58:35.676365 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:35.676365 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:58:35.676365 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:35.676365 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:35.676365 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:35.676365 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:58:35.676365 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:58:35.676365 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:58:35.678178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:58:35.678178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:58:35.678178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:58:35.678178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:58:35.678178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:58:35.678178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:58:35.678178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:58:35.678178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 could not be found. Aug 31 09:58:35.678178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:58:35.678178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:35.678178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:58:35.678178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:35.678178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:35.678178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:35.678178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:58:35.678178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:58:35.678178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 could not be found. Aug 31 09:58:35.678178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:58:35.679563 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-4bb108bf-d592-4010-b722-4beebbd10732 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] Returning 404 to user: Instance e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:58:35.679563 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-4bb108bf-d592-4010-b722-4beebbd10732 tempest-AttachVolumeTestJSON-1716048162 tempest-AttachVolumeTestJSON-1716048162-project] 10.222.0.13 "GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8" status: 404 len: 111 microversion: 2.1 time: 0.050909 Aug 31 09:58:35.679563 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 451/887] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:35 2022] GET /compute/v2.1/servers/e598a8ab-5332-4c3c-8f72-098d0ac6a3c8 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:58:36.058003 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-0d124164-9a5e-4c29-9439-9c254b872bfe tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:36.058774 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-0d124164-9a5e-4c29-9439-9c254b872bfe tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:36.067065 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0d124164-9a5e-4c29-9439-9c254b872bfe tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:36.068077 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0d124164-9a5e-4c29-9439-9c254b872bfe tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:36.068761 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0d124164-9a5e-4c29-9439-9c254b872bfe tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:36.069535 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0d124164-9a5e-4c29-9439-9c254b872bfe tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:36.070320 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0d124164-9a5e-4c29-9439-9c254b872bfe tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:36.071064 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0d124164-9a5e-4c29-9439-9c254b872bfe tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:36.183385 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-a353ec42-6167-4331-a469-ebe82863de77 req-0005b419-b013-41dd-a37b-6dc1d1f1cf7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b32c74c-ed7a-496f-bf84-ce2d50e8b808", "name": "network-vif-deleted", "tag": "a4adc3c8-d787-4f05-8cd2-ace7305b75c0"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:58:36.198703 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-0d124164-9a5e-4c29-9439-9c254b872bfe tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:36.205316 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-a353ec42-6167-4331-a469-ebe82863de77 req-0005b419-b013-41dd-a37b-6dc1d1f1cf7d service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:36.206066 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-a353ec42-6167-4331-a469-ebe82863de77 req-0005b419-b013-41dd-a37b-6dc1d1f1cf7d service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:36.206661 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-a353ec42-6167-4331-a469-ebe82863de77 req-0005b419-b013-41dd-a37b-6dc1d1f1cf7d service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:36.208418 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-0d124164-9a5e-4c29-9439-9c254b872bfe tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1380 microversion: 2.1 time: 0.155278 Aug 31 09:58:36.209246 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 437/888] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:36 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1380 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:36.227963 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-a353ec42-6167-4331-a469-ebe82863de77 req-0005b419-b013-41dd-a37b-6dc1d1f1cf7d service nova] Creating event network-vif-deleted:a4adc3c8-d787-4f05-8cd2-ace7305b75c0 for instance 1b32c74c-ed7a-496f-bf84-ce2d50e8b808 on hv-cinder-84496 Aug 31 09:58:36.234322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-a353ec42-6167-4331-a469-ebe82863de77 req-0005b419-b013-41dd-a37b-6dc1d1f1cf7d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054147 Aug 31 09:58:36.235478 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 452/889] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:58:36.368134 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-2ea7556e-b144-4c50-9be1-6634f6c5df9c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:36.368658 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-2ea7556e-b144-4c50-9be1-6634f6c5df9c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:36.375084 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2ea7556e-b144-4c50-9be1-6634f6c5df9c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:36.375575 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2ea7556e-b144-4c50-9be1-6634f6c5df9c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:36.376016 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2ea7556e-b144-4c50-9be1-6634f6c5df9c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:36.376781 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2ea7556e-b144-4c50-9be1-6634f6c5df9c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:36.377259 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2ea7556e-b144-4c50-9be1-6634f6c5df9c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:36.377794 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2ea7556e-b144-4c50-9be1-6634f6c5df9c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:36.737644 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2ea7556e-b144-4c50-9be1-6634f6c5df9c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:36.752603 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2ea7556e-b144-4c50-9be1-6634f6c5df9c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:36.755854 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2ea7556e-b144-4c50-9be1-6634f6c5df9c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:36.757532 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-2ea7556e-b144-4c50-9be1-6634f6c5df9c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1723 microversion: 2.20 time: 0.394660 Aug 31 09:58:36.770987 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 438/890] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:36 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1723 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:37.247342 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-49ea4296-e28f-49db-b0d5-a9b721ff0696 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:37.250228 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-49ea4296-e28f-49db-b0d5-a9b721ff0696 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:37.262100 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-49ea4296-e28f-49db-b0d5-a9b721ff0696 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:37.262770 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-49ea4296-e28f-49db-b0d5-a9b721ff0696 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:37.263488 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-49ea4296-e28f-49db-b0d5-a9b721ff0696 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:37.264545 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-49ea4296-e28f-49db-b0d5-a9b721ff0696 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:37.265096 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-49ea4296-e28f-49db-b0d5-a9b721ff0696 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:37.265695 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-49ea4296-e28f-49db-b0d5-a9b721ff0696 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:37.309344 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-49ea4296-e28f-49db-b0d5-a9b721ff0696 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:37.310153 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-49ea4296-e28f-49db-b0d5-a9b721ff0696 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:37.310766 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-49ea4296-e28f-49db-b0d5-a9b721ff0696 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:37.311459 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.objects.instance [None req-49ea4296-e28f-49db-b0d5-a9b721ff0696 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lazy-loading 'fault' on Instance uuid 1b32c74c-ed7a-496f-bf84-ce2d50e8b808 {{(pid=127170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:58:37.389111 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-49ea4296-e28f-49db-b0d5-a9b721ff0696 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:37.400921 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-49ea4296-e28f-49db-b0d5-a9b721ff0696 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1223 microversion: 2.1 time: 0.158525 Aug 31 09:58:37.406533 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 453/891] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:37 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1223 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:58:37.788314 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-6a4d46b9-426d-4a8f-887b-60161ca1a3cc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:37.789454 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-6a4d46b9-426d-4a8f-887b-60161ca1a3cc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:37.802640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6a4d46b9-426d-4a8f-887b-60161ca1a3cc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:37.803453 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6a4d46b9-426d-4a8f-887b-60161ca1a3cc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:37.804192 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6a4d46b9-426d-4a8f-887b-60161ca1a3cc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:37.805495 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6a4d46b9-426d-4a8f-887b-60161ca1a3cc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:37.806334 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6a4d46b9-426d-4a8f-887b-60161ca1a3cc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:37.810467 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6a4d46b9-426d-4a8f-887b-60161ca1a3cc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:38.077169 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-6a4d46b9-426d-4a8f-887b-60161ca1a3cc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:38.087378 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-6a4d46b9-426d-4a8f-887b-60161ca1a3cc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:38.089038 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-6a4d46b9-426d-4a8f-887b-60161ca1a3cc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:38.090266 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-6a4d46b9-426d-4a8f-887b-60161ca1a3cc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1723 microversion: 2.20 time: 0.310230 Aug 31 09:58:38.090836 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 439/892] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:37 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1723 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:58:38.441816 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-7dc2b6d5-099a-4138-a888-2db99739451f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:38.442731 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-7dc2b6d5-099a-4138-a888-2db99739451f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:38.450871 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7dc2b6d5-099a-4138-a888-2db99739451f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:38.451465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7dc2b6d5-099a-4138-a888-2db99739451f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:38.453408 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7dc2b6d5-099a-4138-a888-2db99739451f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:38.454406 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7dc2b6d5-099a-4138-a888-2db99739451f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:38.456406 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7dc2b6d5-099a-4138-a888-2db99739451f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:38.461493 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7dc2b6d5-099a-4138-a888-2db99739451f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:38.503531 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7dc2b6d5-099a-4138-a888-2db99739451f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:38.504621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7dc2b6d5-099a-4138-a888-2db99739451f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:38.504969 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7dc2b6d5-099a-4138-a888-2db99739451f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:38.505425 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.objects.instance [None req-7dc2b6d5-099a-4138-a888-2db99739451f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lazy-loading 'fault' on Instance uuid 1b32c74c-ed7a-496f-bf84-ce2d50e8b808 {{(pid=127170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:58:38.560038 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-7dc2b6d5-099a-4138-a888-2db99739451f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89dbe311b24408c925f102eefd6d8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b058d5f34eee47a58629407e166f3499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:38.572709 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-7dc2b6d5-099a-4138-a888-2db99739451f tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 200 len: 1223 microversion: 2.1 time: 0.137554 Aug 31 09:58:38.573336 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 454/893] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:38 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 1223 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:39.123467 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-7c97aa2e-9e5c-47e6-82fa-6c17f394f74b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:39.125174 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-7c97aa2e-9e5c-47e6-82fa-6c17f394f74b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:39.141973 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7c97aa2e-9e5c-47e6-82fa-6c17f394f74b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:39.142638 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7c97aa2e-9e5c-47e6-82fa-6c17f394f74b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:39.143365 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7c97aa2e-9e5c-47e6-82fa-6c17f394f74b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:39.145443 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7c97aa2e-9e5c-47e6-82fa-6c17f394f74b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:39.146648 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7c97aa2e-9e5c-47e6-82fa-6c17f394f74b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:39.147682 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7c97aa2e-9e5c-47e6-82fa-6c17f394f74b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:39.447699 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7c97aa2e-9e5c-47e6-82fa-6c17f394f74b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:39.461060 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7c97aa2e-9e5c-47e6-82fa-6c17f394f74b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:39.462636 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7c97aa2e-9e5c-47e6-82fa-6c17f394f74b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:39.465630 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-7c97aa2e-9e5c-47e6-82fa-6c17f394f74b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1723 microversion: 2.20 time: 0.353760 Aug 31 09:58:39.467016 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 440/894] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:39 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1723 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:39.599521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-cf122f05-7603-4f56-a158-a9700caf4fbf tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:39.600835 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-cf122f05-7603-4f56-a158-a9700caf4fbf tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] [instance: 1b32c74c-ed7a-496f-bf84-ce2d50e8b808] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:39.616294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cf122f05-7603-4f56-a158-a9700caf4fbf tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:39.617426 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cf122f05-7603-4f56-a158-a9700caf4fbf tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:39.618104 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cf122f05-7603-4f56-a158-a9700caf4fbf tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:39.619224 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cf122f05-7603-4f56-a158-a9700caf4fbf tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:39.619896 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cf122f05-7603-4f56-a158-a9700caf4fbf tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:39.620765 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cf122f05-7603-4f56-a158-a9700caf4fbf tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:39.637154 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-cf122f05-7603-4f56-a158-a9700caf4fbf tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] HTTP exception thrown: Instance 1b32c74c-ed7a-496f-bf84-ce2d50e8b808 could not be found. Aug 31 09:58:39.640454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-cf122f05-7603-4f56-a158-a9700caf4fbf tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Request method failure captured: Aug 31 09:58:39.640454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 HTTP/1.1 Aug 31 09:58:39.640454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 09:58:39.640454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 09:58:39.640454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 09:58:39.640454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 09:58:39.640454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 09:58:39.640454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 09:58:39.640454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 09:58:39.640454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 09:58:39.640454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy8Yqe_buxyfLpIY8fHA3-t9qMVtJFrAjt5o3MXDuryL2szHavn1N6Ant0bkQdO_td15ci2affYMur2pdqfm2YZcb0_jm1ikzYEe9A7MZaInT-LKB8uL-Bj0uuftWApMM3G4riQ2PeKXj_tHwMZ_z-M9BQfbcE5zp2-9kEQH17wpXQ0 Aug 31 09:58:39.640454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 09:58:39.640454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 09:58:39.640454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 09:58:39.640454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 09:58:39.640454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 09:58:39.640454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 09:58:39.640454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: b058d5f34eee47a58629407e166f3499 Aug 31 09:58:39.640454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-TestShelveInstance-1545718496 Aug 31 09:58:39.640454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 09:58:39.640454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 09:58:39.641912 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b058d5f34eee47a58629407e166f3499"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b058d5f34eee47a58629407e166f3499"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b058d5f34eee47a58629407e166f3499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b058d5f34eee47a58629407e166f3499"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:58:39.641912 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-TestShelveInstance-1545718496 Aug 31 09:58:39.641912 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: b058d5f34eee47a58629407e166f3499 Aug 31 09:58:39.641912 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-TestShelveInstance-1545718496 Aug 31 09:58:39.641912 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-TestShelveInstance-1545718496-project Aug 31 09:58:39.641912 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 09:58:39.641912 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 09:58:39.641912 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: c89dbe311b24408c925f102eefd6d8c3 Aug 31 09:58:39.641912 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-TestShelveInstance-1545718496-project Aug 31 09:58:39.641912 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 09:58:39.641912 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Instance 1b32c74c-ed7a-496f-bf84-ce2d50e8b808 could not be found. Aug 31 09:58:39.641912 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': '1b32c74c-ed7a-496f-bf84-ce2d50e8b808'} Aug 31 09:58:39.642691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:58:39.642691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:39.642691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:58:39.642691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:58:39.642691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:58:39.642691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:58:39.642691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:58:39.642691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:58:39.642691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:58:39.642691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:58:39.642691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b32c74c-ed7a-496f-bf84-ce2d50e8b808 could not be found. Aug 31 09:58:39.642691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:58:39.642691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:39.642691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:58:39.642691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:39.642691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:39.642691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:39.642691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:58:39.642691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:58:39.642691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:58:39.643915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:58:39.643915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:58:39.643915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:58:39.643915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:58:39.643915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:58:39.643915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:58:39.643915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:58:39.643915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b32c74c-ed7a-496f-bf84-ce2d50e8b808 could not be found. Aug 31 09:58:39.643915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:58:39.643915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:39.643915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:58:39.643915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:39.643915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:39.643915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:39.643915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:58:39.643915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:58:39.643915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b32c74c-ed7a-496f-bf84-ce2d50e8b808 could not be found. Aug 31 09:58:39.643915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:58:39.647091 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-cf122f05-7603-4f56-a158-a9700caf4fbf tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Returning 404 to user: Instance 1b32c74c-ed7a-496f-bf84-ce2d50e8b808 could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:58:39.648252 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-cf122f05-7603-4f56-a158-a9700caf4fbf tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808" status: 404 len: 111 microversion: 2.1 time: 0.056544 Aug 31 09:58:39.649707 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 455/895] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:39 2022] GET /compute/v2.1/servers/1b32c74c-ed7a-496f-bf84-ce2d50e8b808 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:58:39.917769 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-1a6f286f-50c8-43f1-b90a-ebccddaeca15 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] Calling method '.version_select at 0x7f5503c87160>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:39.961943 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-1a6f286f-50c8-43f1-b90a-ebccddaeca15 tempest-TestShelveInstance-1545718496 tempest-TestShelveInstance-1545718496-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-806524526" status: 202 len: 0 microversion: 2.1 time: 0.049354 Aug 31 09:58:39.963111 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 441/896] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Aug 31 09:58:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-806524526 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:58:40.180020 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-b930c268-c413-47cb-9122-ebfdc56ffa62 req-21c41a04-7659-454f-ac2d-a6ce062d4c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9", "name": "network-vif-unplugged", "status": "completed", "tag": "f0ab5d21-97ec-4a21-a75b-253b40f65e47"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:58:40.192106 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-b930c268-c413-47cb-9122-ebfdc56ffa62 req-21c41a04-7659-454f-ac2d-a6ce062d4c18 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:40.192956 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-b930c268-c413-47cb-9122-ebfdc56ffa62 req-21c41a04-7659-454f-ac2d-a6ce062d4c18 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:40.193768 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-b930c268-c413-47cb-9122-ebfdc56ffa62 req-21c41a04-7659-454f-ac2d-a6ce062d4c18 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:40.215245 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.compute.server_external_events [req-b930c268-c413-47cb-9122-ebfdc56ffa62 req-21c41a04-7659-454f-ac2d-a6ce062d4c18 service nova] Unable to find a host for instance b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9. Dropping event network-vif-unplugged {{(pid=127170) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 09:58:40.216394 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-b930c268-c413-47cb-9122-ebfdc56ffa62 req-21c41a04-7659-454f-ac2d-a6ce062d4c18 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040639 Aug 31 09:58:40.220382 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 456/897] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 31 09:58:40.505895 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-3d205097-3b4b-474a-ac33-0c597109c5df tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:40.506660 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-3d205097-3b4b-474a-ac33-0c597109c5df tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:40.516919 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3d205097-3b4b-474a-ac33-0c597109c5df tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:40.518094 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3d205097-3b4b-474a-ac33-0c597109c5df tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:40.518825 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3d205097-3b4b-474a-ac33-0c597109c5df tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:40.521768 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3d205097-3b4b-474a-ac33-0c597109c5df tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:40.522784 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3d205097-3b4b-474a-ac33-0c597109c5df tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:40.523481 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3d205097-3b4b-474a-ac33-0c597109c5df tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:40.547156 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=100 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:40.773874 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-3d205097-3b4b-474a-ac33-0c597109c5df tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:40.788861 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-3d205097-3b4b-474a-ac33-0c597109c5df tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:40.792146 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-3d205097-3b4b-474a-ac33-0c597109c5df tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:40.794532 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-3d205097-3b4b-474a-ac33-0c597109c5df tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1666 microversion: 2.20 time: 0.293668 Aug 31 09:58:40.795503 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 442/898] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:40 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1666 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:40.835375 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-bbe373ec-63cd-45ff-a012-4ab144aa2d87 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cdfa4ddc-296f-4722-8e5a-596a603705b0"}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:58:40.839412 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-bbe373ec-63cd-45ff-a012-4ab144aa2d87 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:40.852066 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bbe373ec-63cd-45ff-a012-4ab144aa2d87 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:40.853340 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bbe373ec-63cd-45ff-a012-4ab144aa2d87 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:40.854459 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bbe373ec-63cd-45ff-a012-4ab144aa2d87 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:40.855833 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bbe373ec-63cd-45ff-a012-4ab144aa2d87 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:40.856965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bbe373ec-63cd-45ff-a012-4ab144aa2d87 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:40.858062 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bbe373ec-63cd-45ff-a012-4ab144aa2d87 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:41.411714 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-bbe373ec-63cd-45ff-a012-4ab144aa2d87 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "POST /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.582709 Aug 31 09:58:41.414728 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 457/899] 10.222.0.13 () {62 vars in 1364 bytes} [Wed Aug 31 09:58:40 2022] POST /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9/os-volume_attachments => generated 188 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:58:41.599283 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-800d6784-8be9-4719-be31-e2c2a3a3deb4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:58:41.601738 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-800d6784-8be9-4719-be31-e2c2a3a3deb4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:41.612210 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-800d6784-8be9-4719-be31-e2c2a3a3deb4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:41.613408 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-800d6784-8be9-4719-be31-e2c2a3a3deb4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:41.614361 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-800d6784-8be9-4719-be31-e2c2a3a3deb4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:41.615589 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-800d6784-8be9-4719-be31-e2c2a3a3deb4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:41.616226 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-800d6784-8be9-4719-be31-e2c2a3a3deb4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:41.616822 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-800d6784-8be9-4719-be31-e2c2a3a3deb4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:41.686166 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-800d6784-8be9-4719-be31-e2c2a3a3deb4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127171) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 09:58:41.823010 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-800d6784-8be9-4719-be31-e2c2a3a3deb4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "POST /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9/action" status: 202 len: 0 microversion: 2.20 time: 0.230612 Aug 31 09:58:41.824585 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 443/900] 10.222.0.13 () {62 vars in 1319 bytes} [Wed Aug 31 09:58:41 2022] POST /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:58:41.833375 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-7a4b37c8-5b99-4e5d-ab3b-e8072d7f1863 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:41.834646 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-7a4b37c8-5b99-4e5d-ab3b-e8072d7f1863 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:41.843128 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7a4b37c8-5b99-4e5d-ab3b-e8072d7f1863 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:41.844766 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7a4b37c8-5b99-4e5d-ab3b-e8072d7f1863 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:41.845673 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7a4b37c8-5b99-4e5d-ab3b-e8072d7f1863 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:41.847949 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7a4b37c8-5b99-4e5d-ab3b-e8072d7f1863 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:41.849415 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7a4b37c8-5b99-4e5d-ab3b-e8072d7f1863 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:41.850126 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7a4b37c8-5b99-4e5d-ab3b-e8072d7f1863 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:42.205072 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-7a4b37c8-5b99-4e5d-ab3b-e8072d7f1863 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:42.226417 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-7a4b37c8-5b99-4e5d-ab3b-e8072d7f1863 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:42.230615 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-7a4b37c8-5b99-4e5d-ab3b-e8072d7f1863 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:42.233040 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-7a4b37c8-5b99-4e5d-ab3b-e8072d7f1863 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1752 microversion: 2.20 time: 0.404037 Aug 31 09:58:42.235159 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 458/901] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:41 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1752 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:58:43.261794 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-49e9df66-2588-4fc2-826c-4831f21ababb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:43.263246 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-49e9df66-2588-4fc2-826c-4831f21ababb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:43.273767 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-49e9df66-2588-4fc2-826c-4831f21ababb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:43.274578 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-49e9df66-2588-4fc2-826c-4831f21ababb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:43.275317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-49e9df66-2588-4fc2-826c-4831f21ababb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:43.276501 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-49e9df66-2588-4fc2-826c-4831f21ababb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:43.277284 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-49e9df66-2588-4fc2-826c-4831f21ababb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:43.278082 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-49e9df66-2588-4fc2-826c-4831f21ababb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:43.566090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-49e9df66-2588-4fc2-826c-4831f21ababb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:43.578455 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-49e9df66-2588-4fc2-826c-4831f21ababb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:43.579897 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-49e9df66-2588-4fc2-826c-4831f21ababb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:43.584794 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-49e9df66-2588-4fc2-826c-4831f21ababb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1752 microversion: 2.20 time: 0.328418 Aug 31 09:58:43.609231 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 444/902] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:43 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1752 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:58:44.617498 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-05d16b79-4b99-4303-afa9-d83e33413396 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:44.618378 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-05d16b79-4b99-4303-afa9-d83e33413396 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:44.625709 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-05d16b79-4b99-4303-afa9-d83e33413396 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:44.626208 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-05d16b79-4b99-4303-afa9-d83e33413396 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:44.626642 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-05d16b79-4b99-4303-afa9-d83e33413396 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:44.627374 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-05d16b79-4b99-4303-afa9-d83e33413396 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:44.628037 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-05d16b79-4b99-4303-afa9-d83e33413396 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:44.628461 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-05d16b79-4b99-4303-afa9-d83e33413396 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:44.875982 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-05d16b79-4b99-4303-afa9-d83e33413396 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:44.903923 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-05d16b79-4b99-4303-afa9-d83e33413396 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:44.915399 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-05d16b79-4b99-4303-afa9-d83e33413396 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:44.916742 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-05d16b79-4b99-4303-afa9-d83e33413396 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1754 microversion: 2.20 time: 0.303999 Aug 31 09:58:44.920857 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 459/903] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:44 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1754 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:45.946312 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-e63f5613-02a3-48e3-9ca6-4010e372400d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:45.947302 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-e63f5613-02a3-48e3-9ca6-4010e372400d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:45.957983 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e63f5613-02a3-48e3-9ca6-4010e372400d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:45.958859 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e63f5613-02a3-48e3-9ca6-4010e372400d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:45.959605 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e63f5613-02a3-48e3-9ca6-4010e372400d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:45.961078 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e63f5613-02a3-48e3-9ca6-4010e372400d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:45.961897 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e63f5613-02a3-48e3-9ca6-4010e372400d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:45.962670 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e63f5613-02a3-48e3-9ca6-4010e372400d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:46.314189 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-e63f5613-02a3-48e3-9ca6-4010e372400d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:46.336230 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-e63f5613-02a3-48e3-9ca6-4010e372400d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:46.339264 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-e63f5613-02a3-48e3-9ca6-4010e372400d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:46.341607 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-e63f5613-02a3-48e3-9ca6-4010e372400d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.403704 Aug 31 09:58:46.342930 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 445/904] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:45 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:47.384278 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-cd53f70b-2885-4dd1-a2b2-0e8279650653 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:47.385270 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-cd53f70b-2885-4dd1-a2b2-0e8279650653 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:47.410928 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cd53f70b-2885-4dd1-a2b2-0e8279650653 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:47.412124 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cd53f70b-2885-4dd1-a2b2-0e8279650653 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:47.413152 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cd53f70b-2885-4dd1-a2b2-0e8279650653 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:47.414938 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cd53f70b-2885-4dd1-a2b2-0e8279650653 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:47.415760 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cd53f70b-2885-4dd1-a2b2-0e8279650653 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:47.417963 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cd53f70b-2885-4dd1-a2b2-0e8279650653 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:47.783432 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-cd53f70b-2885-4dd1-a2b2-0e8279650653 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:47.803445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-cd53f70b-2885-4dd1-a2b2-0e8279650653 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:47.806630 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-cd53f70b-2885-4dd1-a2b2-0e8279650653 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:47.808630 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-cd53f70b-2885-4dd1-a2b2-0e8279650653 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.433951 Aug 31 09:58:47.810083 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 460/905] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:47 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:48.853560 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-7b16da96-296c-42d5-acca-c3b8b135a590 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:48.855131 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-7b16da96-296c-42d5-acca-c3b8b135a590 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:48.900438 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7b16da96-296c-42d5-acca-c3b8b135a590 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:48.903006 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7b16da96-296c-42d5-acca-c3b8b135a590 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:48.906590 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7b16da96-296c-42d5-acca-c3b8b135a590 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:48.907843 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7b16da96-296c-42d5-acca-c3b8b135a590 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:48.908671 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7b16da96-296c-42d5-acca-c3b8b135a590 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:48.909458 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7b16da96-296c-42d5-acca-c3b8b135a590 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:49.305022 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7b16da96-296c-42d5-acca-c3b8b135a590 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:49.319760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7b16da96-296c-42d5-acca-c3b8b135a590 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:49.321245 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7b16da96-296c-42d5-acca-c3b8b135a590 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:49.322537 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-7b16da96-296c-42d5-acca-c3b8b135a590 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.487304 Aug 31 09:58:49.323113 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 446/906] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:48 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:50.352603 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-1f954e45-e91d-4700-bc7f-11d039b99a1e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:50.353547 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-1f954e45-e91d-4700-bc7f-11d039b99a1e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:50.370987 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:50.375639 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1f954e45-e91d-4700-bc7f-11d039b99a1e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:50.376877 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1f954e45-e91d-4700-bc7f-11d039b99a1e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:50.378086 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1f954e45-e91d-4700-bc7f-11d039b99a1e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:50.380345 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1f954e45-e91d-4700-bc7f-11d039b99a1e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:50.381866 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1f954e45-e91d-4700-bc7f-11d039b99a1e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:50.383155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1f954e45-e91d-4700-bc7f-11d039b99a1e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:50.791018 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-1f954e45-e91d-4700-bc7f-11d039b99a1e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:50.812622 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-1f954e45-e91d-4700-bc7f-11d039b99a1e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:50.818178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-1f954e45-e91d-4700-bc7f-11d039b99a1e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:50.826058 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-1f954e45-e91d-4700-bc7f-11d039b99a1e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.480532 Aug 31 09:58:50.828657 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 461/907] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:50 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:51.854508 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-743d96d8-30ab-4fcc-9f72-e129d7258bdf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:51.855907 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-743d96d8-30ab-4fcc-9f72-e129d7258bdf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:51.859145 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:51.866931 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-743d96d8-30ab-4fcc-9f72-e129d7258bdf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:51.867945 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-743d96d8-30ab-4fcc-9f72-e129d7258bdf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:51.868933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-743d96d8-30ab-4fcc-9f72-e129d7258bdf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:51.870753 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-743d96d8-30ab-4fcc-9f72-e129d7258bdf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:51.871628 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-743d96d8-30ab-4fcc-9f72-e129d7258bdf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:51.872407 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-743d96d8-30ab-4fcc-9f72-e129d7258bdf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:52.168294 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-743d96d8-30ab-4fcc-9f72-e129d7258bdf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:52.193277 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-743d96d8-30ab-4fcc-9f72-e129d7258bdf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:52.201412 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-743d96d8-30ab-4fcc-9f72-e129d7258bdf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:52.208194 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-743d96d8-30ab-4fcc-9f72-e129d7258bdf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.360246 Aug 31 09:58:52.208950 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 447/908] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:51 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:58:53.245654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-09bc1bd6-6216-47a2-a98d-8044cd871348 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:53.247094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-09bc1bd6-6216-47a2-a98d-8044cd871348 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:53.262035 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-09bc1bd6-6216-47a2-a98d-8044cd871348 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:53.262762 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-09bc1bd6-6216-47a2-a98d-8044cd871348 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:53.263422 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-09bc1bd6-6216-47a2-a98d-8044cd871348 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:53.265942 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-09bc1bd6-6216-47a2-a98d-8044cd871348 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:53.267163 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-09bc1bd6-6216-47a2-a98d-8044cd871348 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:53.273618 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-09bc1bd6-6216-47a2-a98d-8044cd871348 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:53.325330 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:53.657317 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-09bc1bd6-6216-47a2-a98d-8044cd871348 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:53.676680 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-09bc1bd6-6216-47a2-a98d-8044cd871348 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:53.678650 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-09bc1bd6-6216-47a2-a98d-8044cd871348 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:53.680181 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-09bc1bd6-6216-47a2-a98d-8044cd871348 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.438601 Aug 31 09:58:53.693228 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 462/909] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:53 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:54.709463 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-b56b238b-45c9-499f-aab5-66546d0b8ade tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:54.710867 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-b56b238b-45c9-499f-aab5-66546d0b8ade tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:54.718237 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b56b238b-45c9-499f-aab5-66546d0b8ade tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:54.718846 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b56b238b-45c9-499f-aab5-66546d0b8ade tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:54.719412 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b56b238b-45c9-499f-aab5-66546d0b8ade tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:54.720183 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b56b238b-45c9-499f-aab5-66546d0b8ade tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:54.720714 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b56b238b-45c9-499f-aab5-66546d0b8ade tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:54.721207 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b56b238b-45c9-499f-aab5-66546d0b8ade tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:54.908220 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b56b238b-45c9-499f-aab5-66546d0b8ade tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:54.919227 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b56b238b-45c9-499f-aab5-66546d0b8ade tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:54.921429 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b56b238b-45c9-499f-aab5-66546d0b8ade tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:54.922393 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-b56b238b-45c9-499f-aab5-66546d0b8ade tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.218477 Aug 31 09:58:54.922967 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 448/910] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:54 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:55.948954 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-5348696e-d515-4589-88f2-d7ac06c03e66 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:55.949603 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-5348696e-d515-4589-88f2-d7ac06c03e66 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:55.956958 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5348696e-d515-4589-88f2-d7ac06c03e66 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:55.957592 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5348696e-d515-4589-88f2-d7ac06c03e66 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:55.958057 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5348696e-d515-4589-88f2-d7ac06c03e66 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:55.958749 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5348696e-d515-4589-88f2-d7ac06c03e66 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:55.959198 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5348696e-d515-4589-88f2-d7ac06c03e66 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:55.959615 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5348696e-d515-4589-88f2-d7ac06c03e66 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:56.112108 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-5348696e-d515-4589-88f2-d7ac06c03e66 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:56.122595 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-5348696e-d515-4589-88f2-d7ac06c03e66 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:56.124063 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-5348696e-d515-4589-88f2-d7ac06c03e66 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:56.125238 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-5348696e-d515-4589-88f2-d7ac06c03e66 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.180305 Aug 31 09:58:56.125878 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 463/911] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:55 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:57.150030 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-2c919827-ecf1-4f6a-aa32-8ae57d9bb18d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:57.151091 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-2c919827-ecf1-4f6a-aa32-8ae57d9bb18d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:57.157957 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2c919827-ecf1-4f6a-aa32-8ae57d9bb18d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:57.158546 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2c919827-ecf1-4f6a-aa32-8ae57d9bb18d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:57.159065 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2c919827-ecf1-4f6a-aa32-8ae57d9bb18d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:57.159928 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2c919827-ecf1-4f6a-aa32-8ae57d9bb18d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:57.160438 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2c919827-ecf1-4f6a-aa32-8ae57d9bb18d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:57.160928 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2c919827-ecf1-4f6a-aa32-8ae57d9bb18d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:57.324650 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2c919827-ecf1-4f6a-aa32-8ae57d9bb18d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:57.334386 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2c919827-ecf1-4f6a-aa32-8ae57d9bb18d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:57.335874 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2c919827-ecf1-4f6a-aa32-8ae57d9bb18d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:57.337027 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-2c919827-ecf1-4f6a-aa32-8ae57d9bb18d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.191195 Aug 31 09:58:57.337636 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 449/912] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:57 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:58.366445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-7627895b-9157-4056-aadd-fb6ed8aa128e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:58.367188 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-7627895b-9157-4056-aadd-fb6ed8aa128e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:58.374110 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7627895b-9157-4056-aadd-fb6ed8aa128e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:58.374599 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7627895b-9157-4056-aadd-fb6ed8aa128e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:58.375032 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7627895b-9157-4056-aadd-fb6ed8aa128e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:58.375737 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7627895b-9157-4056-aadd-fb6ed8aa128e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:58.376184 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7627895b-9157-4056-aadd-fb6ed8aa128e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:58.376604 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7627895b-9157-4056-aadd-fb6ed8aa128e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:58.538502 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-7627895b-9157-4056-aadd-fb6ed8aa128e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:58.550787 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-7627895b-9157-4056-aadd-fb6ed8aa128e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:58.552339 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-7627895b-9157-4056-aadd-fb6ed8aa128e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:58.553555 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-7627895b-9157-4056-aadd-fb6ed8aa128e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.192081 Aug 31 09:58:58.557318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 464/913] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:58 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:58:59.576543 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-398a7b95-587a-48a5-99dd-55b5ab0b4944 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:59.577142 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-398a7b95-587a-48a5-99dd-55b5ab0b4944 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:59.584343 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-398a7b95-587a-48a5-99dd-55b5ab0b4944 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:59.584854 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-398a7b95-587a-48a5-99dd-55b5ab0b4944 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:59.585271 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-398a7b95-587a-48a5-99dd-55b5ab0b4944 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:59.586003 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-398a7b95-587a-48a5-99dd-55b5ab0b4944 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:59.586453 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-398a7b95-587a-48a5-99dd-55b5ab0b4944 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:59.586904 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-398a7b95-587a-48a5-99dd-55b5ab0b4944 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:59.743185 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-398a7b95-587a-48a5-99dd-55b5ab0b4944 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:59.752276 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-398a7b95-587a-48a5-99dd-55b5ab0b4944 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:59.754685 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-398a7b95-587a-48a5-99dd-55b5ab0b4944 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:59.756066 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-398a7b95-587a-48a5-99dd-55b5ab0b4944 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.183475 Aug 31 09:58:59.756649 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 450/914] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:58:59 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:59:00.779245 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-5b29d7d8-a2fe-49c4-9e31-089781a608b8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:00.779858 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-5b29d7d8-a2fe-49c4-9e31-089781a608b8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:00.787269 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5b29d7d8-a2fe-49c4-9e31-089781a608b8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:00.787760 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5b29d7d8-a2fe-49c4-9e31-089781a608b8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:00.788202 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5b29d7d8-a2fe-49c4-9e31-089781a608b8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:00.788906 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5b29d7d8-a2fe-49c4-9e31-089781a608b8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:00.789354 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5b29d7d8-a2fe-49c4-9e31-089781a608b8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:00.789804 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-5b29d7d8-a2fe-49c4-9e31-089781a608b8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:00.942391 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-5b29d7d8-a2fe-49c4-9e31-089781a608b8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:00.951622 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-5b29d7d8-a2fe-49c4-9e31-089781a608b8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:00.953050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-5b29d7d8-a2fe-49c4-9e31-089781a608b8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:00.954256 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-5b29d7d8-a2fe-49c4-9e31-089781a608b8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.178984 Aug 31 09:59:00.954813 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 465/915] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:59:00 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:59:01.978337 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-cb64853d-90e8-4218-b4af-370e2fc8914a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:01.978951 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-cb64853d-90e8-4218-b4af-370e2fc8914a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:01.985811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cb64853d-90e8-4218-b4af-370e2fc8914a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:01.986299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cb64853d-90e8-4218-b4af-370e2fc8914a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:01.986732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cb64853d-90e8-4218-b4af-370e2fc8914a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:01.987430 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cb64853d-90e8-4218-b4af-370e2fc8914a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:01.988318 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cb64853d-90e8-4218-b4af-370e2fc8914a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:01.988741 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-cb64853d-90e8-4218-b4af-370e2fc8914a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:02.131727 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-cb64853d-90e8-4218-b4af-370e2fc8914a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:02.140815 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-cb64853d-90e8-4218-b4af-370e2fc8914a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:02.142299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-cb64853d-90e8-4218-b4af-370e2fc8914a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:02.143474 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-cb64853d-90e8-4218-b4af-370e2fc8914a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.169114 Aug 31 09:59:02.144653 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 451/916] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:59:01 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:59:03.167683 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-fbf733e1-7f2b-4c12-90b1-28edb6708836 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:03.168215 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-fbf733e1-7f2b-4c12-90b1-28edb6708836 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:03.175153 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fbf733e1-7f2b-4c12-90b1-28edb6708836 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:03.175891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fbf733e1-7f2b-4c12-90b1-28edb6708836 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:03.176518 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fbf733e1-7f2b-4c12-90b1-28edb6708836 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:03.177416 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fbf733e1-7f2b-4c12-90b1-28edb6708836 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:03.177870 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fbf733e1-7f2b-4c12-90b1-28edb6708836 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:03.178370 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fbf733e1-7f2b-4c12-90b1-28edb6708836 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:03.333213 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-fbf733e1-7f2b-4c12-90b1-28edb6708836 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:03.342245 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-fbf733e1-7f2b-4c12-90b1-28edb6708836 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:03.343681 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-fbf733e1-7f2b-4c12-90b1-28edb6708836 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:03.344853 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-fbf733e1-7f2b-4c12-90b1-28edb6708836 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.181525 Aug 31 09:59:03.345503 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 466/917] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:59:03 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:59:04.370536 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-ea260e61-c703-485e-b124-6d483ed52625 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:04.371152 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-ea260e61-c703-485e-b124-6d483ed52625 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:04.377888 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ea260e61-c703-485e-b124-6d483ed52625 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:04.378399 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ea260e61-c703-485e-b124-6d483ed52625 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:04.379089 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ea260e61-c703-485e-b124-6d483ed52625 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:04.379943 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ea260e61-c703-485e-b124-6d483ed52625 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:04.380455 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ea260e61-c703-485e-b124-6d483ed52625 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:04.380746 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ea260e61-c703-485e-b124-6d483ed52625 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:04.532488 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-ea260e61-c703-485e-b124-6d483ed52625 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:04.544931 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-ea260e61-c703-485e-b124-6d483ed52625 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:04.546412 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-ea260e61-c703-485e-b124-6d483ed52625 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:04.547626 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-ea260e61-c703-485e-b124-6d483ed52625 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.181226 Aug 31 09:59:04.548304 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 452/918] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:59:04 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:59:05.571585 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-1b9279a4-d53e-4a29-8bbb-fcafb0822a20 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:05.572334 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-1b9279a4-d53e-4a29-8bbb-fcafb0822a20 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:05.578929 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1b9279a4-d53e-4a29-8bbb-fcafb0822a20 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:05.579420 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1b9279a4-d53e-4a29-8bbb-fcafb0822a20 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:05.579858 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1b9279a4-d53e-4a29-8bbb-fcafb0822a20 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:05.580557 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1b9279a4-d53e-4a29-8bbb-fcafb0822a20 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:05.581010 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1b9279a4-d53e-4a29-8bbb-fcafb0822a20 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:05.582036 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1b9279a4-d53e-4a29-8bbb-fcafb0822a20 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:05.836129 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-1b9279a4-d53e-4a29-8bbb-fcafb0822a20 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:05.852086 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-1b9279a4-d53e-4a29-8bbb-fcafb0822a20 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:05.854530 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-1b9279a4-d53e-4a29-8bbb-fcafb0822a20 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:05.855915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-1b9279a4-d53e-4a29-8bbb-fcafb0822a20 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.288638 Aug 31 09:59:05.856711 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 467/919] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:59:05 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:59:06.888272 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-47d35d09-0fb2-4b23-8506-b1c7806b774f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:06.889010 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-47d35d09-0fb2-4b23-8506-b1c7806b774f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:06.897026 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-47d35d09-0fb2-4b23-8506-b1c7806b774f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:06.898466 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-47d35d09-0fb2-4b23-8506-b1c7806b774f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:06.898466 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-47d35d09-0fb2-4b23-8506-b1c7806b774f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:06.898912 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-47d35d09-0fb2-4b23-8506-b1c7806b774f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:06.899374 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-47d35d09-0fb2-4b23-8506-b1c7806b774f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:06.899801 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-47d35d09-0fb2-4b23-8506-b1c7806b774f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:07.041353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-47d35d09-0fb2-4b23-8506-b1c7806b774f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:07.050885 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-47d35d09-0fb2-4b23-8506-b1c7806b774f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:07.052331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-47d35d09-0fb2-4b23-8506-b1c7806b774f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:07.053539 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-47d35d09-0fb2-4b23-8506-b1c7806b774f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.172327 Aug 31 09:59:07.054107 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 453/920] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:59:06 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:59:08.076733 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-fa6c580e-7591-4901-9036-fb3aea6d3be5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:08.077473 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-fa6c580e-7591-4901-9036-fb3aea6d3be5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:08.085162 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fa6c580e-7591-4901-9036-fb3aea6d3be5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:08.085696 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fa6c580e-7591-4901-9036-fb3aea6d3be5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:08.086137 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fa6c580e-7591-4901-9036-fb3aea6d3be5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:08.086842 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fa6c580e-7591-4901-9036-fb3aea6d3be5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:08.087294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fa6c580e-7591-4901-9036-fb3aea6d3be5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:08.087713 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fa6c580e-7591-4901-9036-fb3aea6d3be5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:08.339417 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-fa6c580e-7591-4901-9036-fb3aea6d3be5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:08.350155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-fa6c580e-7591-4901-9036-fb3aea6d3be5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:08.351574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-fa6c580e-7591-4901-9036-fb3aea6d3be5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:08.352744 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-fa6c580e-7591-4901-9036-fb3aea6d3be5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.280109 Aug 31 09:59:08.353307 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 468/921] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:59:08 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:59:09.376336 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-1dec246f-457d-40c5-b7a8-6a0b1b9a1bcc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:09.376955 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-1dec246f-457d-40c5-b7a8-6a0b1b9a1bcc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:09.384339 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1dec246f-457d-40c5-b7a8-6a0b1b9a1bcc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:09.384830 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1dec246f-457d-40c5-b7a8-6a0b1b9a1bcc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:09.385263 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1dec246f-457d-40c5-b7a8-6a0b1b9a1bcc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:09.386008 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1dec246f-457d-40c5-b7a8-6a0b1b9a1bcc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:09.386458 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1dec246f-457d-40c5-b7a8-6a0b1b9a1bcc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:09.386892 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1dec246f-457d-40c5-b7a8-6a0b1b9a1bcc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:09.539076 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-1dec246f-457d-40c5-b7a8-6a0b1b9a1bcc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:09.557461 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-1dec246f-457d-40c5-b7a8-6a0b1b9a1bcc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:09.560200 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-1dec246f-457d-40c5-b7a8-6a0b1b9a1bcc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:09.562517 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-1dec246f-457d-40c5-b7a8-6a0b1b9a1bcc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.189937 Aug 31 09:59:09.563587 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 454/922] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:59:09 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:59:10.587367 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-c8366061-42a7-46c1-9b96-39bd8fb28da7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:10.587988 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-c8366061-42a7-46c1-9b96-39bd8fb28da7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:10.594332 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8366061-42a7-46c1-9b96-39bd8fb28da7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:10.594875 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8366061-42a7-46c1-9b96-39bd8fb28da7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:10.595309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8366061-42a7-46c1-9b96-39bd8fb28da7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:10.596182 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8366061-42a7-46c1-9b96-39bd8fb28da7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:10.598090 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8366061-42a7-46c1-9b96-39bd8fb28da7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:10.598658 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8366061-42a7-46c1-9b96-39bd8fb28da7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:10.758497 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-c8366061-42a7-46c1-9b96-39bd8fb28da7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:10.768346 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-c8366061-42a7-46c1-9b96-39bd8fb28da7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:10.770696 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-c8366061-42a7-46c1-9b96-39bd8fb28da7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:10.772160 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-c8366061-42a7-46c1-9b96-39bd8fb28da7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.189409 Aug 31 09:59:10.772823 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 469/923] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:59:10 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:59:11.795877 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-a3c987b4-6794-4f1a-b54a-aed9b3847ab1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:11.796493 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-a3c987b4-6794-4f1a-b54a-aed9b3847ab1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:11.804194 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a3c987b4-6794-4f1a-b54a-aed9b3847ab1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:11.804966 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a3c987b4-6794-4f1a-b54a-aed9b3847ab1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:11.805824 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a3c987b4-6794-4f1a-b54a-aed9b3847ab1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:11.807409 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a3c987b4-6794-4f1a-b54a-aed9b3847ab1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:11.808649 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a3c987b4-6794-4f1a-b54a-aed9b3847ab1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:11.809664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a3c987b4-6794-4f1a-b54a-aed9b3847ab1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:11.826436 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:11.975457 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-a3c987b4-6794-4f1a-b54a-aed9b3847ab1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:11.990268 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-a3c987b4-6794-4f1a-b54a-aed9b3847ab1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:11.991747 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-a3c987b4-6794-4f1a-b54a-aed9b3847ab1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:11.992982 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-a3c987b4-6794-4f1a-b54a-aed9b3847ab1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.201096 Aug 31 09:59:11.994179 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 455/924] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:59:11 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:59:13.019183 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-1d062c09-f4d1-4d45-be1c-c5477835f75e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:13.020304 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-1d062c09-f4d1-4d45-be1c-c5477835f75e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:13.027375 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1d062c09-f4d1-4d45-be1c-c5477835f75e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:13.027956 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1d062c09-f4d1-4d45-be1c-c5477835f75e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:13.028318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1d062c09-f4d1-4d45-be1c-c5477835f75e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:13.029018 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1d062c09-f4d1-4d45-be1c-c5477835f75e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:13.029534 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1d062c09-f4d1-4d45-be1c-c5477835f75e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:13.029917 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1d062c09-f4d1-4d45-be1c-c5477835f75e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:13.167832 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-1d062c09-f4d1-4d45-be1c-c5477835f75e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:13.176861 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-1d062c09-f4d1-4d45-be1c-c5477835f75e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:13.178236 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-1d062c09-f4d1-4d45-be1c-c5477835f75e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:13.179380 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-1d062c09-f4d1-4d45-be1c-c5477835f75e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.164827 Aug 31 09:59:13.179933 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 470/925] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:59:13 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:59:14.204119 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-b4727b2c-d339-4937-aa9e-b498634fa3d8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:14.204859 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-b4727b2c-d339-4937-aa9e-b498634fa3d8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:14.211956 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b4727b2c-d339-4937-aa9e-b498634fa3d8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:14.212438 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b4727b2c-d339-4937-aa9e-b498634fa3d8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:14.212871 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b4727b2c-d339-4937-aa9e-b498634fa3d8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:14.213599 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b4727b2c-d339-4937-aa9e-b498634fa3d8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:14.214126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b4727b2c-d339-4937-aa9e-b498634fa3d8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:14.214549 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b4727b2c-d339-4937-aa9e-b498634fa3d8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:14.365143 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b4727b2c-d339-4937-aa9e-b498634fa3d8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:14.373941 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b4727b2c-d339-4937-aa9e-b498634fa3d8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:14.375393 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b4727b2c-d339-4937-aa9e-b498634fa3d8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:14.376566 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-b4727b2c-d339-4937-aa9e-b498634fa3d8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.177895 Aug 31 09:59:14.377139 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 456/926] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:59:14 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:59:15.400169 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-28b7eb05-4d4b-468e-8d87-6b7e1bd4bf64 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:15.400774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-28b7eb05-4d4b-468e-8d87-6b7e1bd4bf64 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:15.407294 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-28b7eb05-4d4b-468e-8d87-6b7e1bd4bf64 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:15.407802 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-28b7eb05-4d4b-468e-8d87-6b7e1bd4bf64 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:15.408249 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-28b7eb05-4d4b-468e-8d87-6b7e1bd4bf64 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:15.408920 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-28b7eb05-4d4b-468e-8d87-6b7e1bd4bf64 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:15.409368 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-28b7eb05-4d4b-468e-8d87-6b7e1bd4bf64 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:15.409813 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-28b7eb05-4d4b-468e-8d87-6b7e1bd4bf64 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:15.551684 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-28b7eb05-4d4b-468e-8d87-6b7e1bd4bf64 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:15.560945 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-28b7eb05-4d4b-468e-8d87-6b7e1bd4bf64 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:15.562408 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-28b7eb05-4d4b-468e-8d87-6b7e1bd4bf64 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:15.563594 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-28b7eb05-4d4b-468e-8d87-6b7e1bd4bf64 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.167851 Aug 31 09:59:15.564160 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 471/927] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:59:15 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:59:16.588292 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-198900e1-cc3b-43bc-ae2c-bf9e9e9289bd tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:16.589002 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-198900e1-cc3b-43bc-ae2c-bf9e9e9289bd tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:16.595757 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-198900e1-cc3b-43bc-ae2c-bf9e9e9289bd tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:16.596536 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-198900e1-cc3b-43bc-ae2c-bf9e9e9289bd tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:16.596976 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-198900e1-cc3b-43bc-ae2c-bf9e9e9289bd tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:16.597723 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-198900e1-cc3b-43bc-ae2c-bf9e9e9289bd tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:16.598767 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-198900e1-cc3b-43bc-ae2c-bf9e9e9289bd tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:16.599376 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-198900e1-cc3b-43bc-ae2c-bf9e9e9289bd tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:16.671085 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-ab2a4aca-71a2-4a38-921b-43ecf2082df1 req-0094b58f-96aa-4cad-b1a6-1343823b3c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9", "name": "network-vif-plugged", "status": "completed", "tag": "f0ab5d21-97ec-4a21-a75b-253b40f65e47"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:16.681273 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-ab2a4aca-71a2-4a38-921b-43ecf2082df1 req-0094b58f-96aa-4cad-b1a6-1343823b3c84 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:16.681776 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-ab2a4aca-71a2-4a38-921b-43ecf2082df1 req-0094b58f-96aa-4cad-b1a6-1343823b3c84 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:16.682283 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-ab2a4aca-71a2-4a38-921b-43ecf2082df1 req-0094b58f-96aa-4cad-b1a6-1343823b3c84 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:16.694966 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-ab2a4aca-71a2-4a38-921b-43ecf2082df1 req-0094b58f-96aa-4cad-b1a6-1343823b3c84 service nova] Creating event network-vif-plugged:f0ab5d21-97ec-4a21-a75b-253b40f65e47 for instance b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 on hv-cinder-84496 Aug 31 09:59:16.700315 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-ab2a4aca-71a2-4a38-921b-43ecf2082df1 req-0094b58f-96aa-4cad-b1a6-1343823b3c84 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172736 Aug 31 09:59:16.700996 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 457/928] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:59:16.746340 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-198900e1-cc3b-43bc-ae2c-bf9e9e9289bd tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:16.756463 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-198900e1-cc3b-43bc-ae2c-bf9e9e9289bd tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:16.758019 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-198900e1-cc3b-43bc-ae2c-bf9e9e9289bd tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:16.759247 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-198900e1-cc3b-43bc-ae2c-bf9e9e9289bd tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.174899 Aug 31 09:59:16.759817 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 472/929] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:59:16 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:59:17.265823 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-e83b17c6-89ac-4de3-8c90-38b441d520ee tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-799990242", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-235501854", "security_groups": [{"name": "tempest-secgroup-smoke-1528914323"}], "block_device_mapping_v2": [{"uuid": "e7e176ec-d197-45be-88b6-a2bca5ed1882", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b98f4fc3-1d55-4d78-8d5f-4e68e4b2b75a"}]}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:17.423939 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.network.neutron [None req-e83b17c6-89ac-4de3-8c90-38b441d520ee tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] validate_networks() for [('b98f4fc3-1d55-4d78-8d5f-4e68e4b2b75a', None, None, None, None, None)] {{(pid=127171) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:59:17.782668 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-50f7e48d-0dda-4d5f-84e6-3c0289bd6a76 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:17.783272 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-50f7e48d-0dda-4d5f-84e6-3c0289bd6a76 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:17.790586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-50f7e48d-0dda-4d5f-84e6-3c0289bd6a76 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:17.791062 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-50f7e48d-0dda-4d5f-84e6-3c0289bd6a76 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:17.791490 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-50f7e48d-0dda-4d5f-84e6-3c0289bd6a76 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:17.792175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-50f7e48d-0dda-4d5f-84e6-3c0289bd6a76 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:17.792624 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-50f7e48d-0dda-4d5f-84e6-3c0289bd6a76 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:17.793036 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-50f7e48d-0dda-4d5f-84e6-3c0289bd6a76 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:17.843638 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-e83b17c6-89ac-4de3-8c90-38b441d520ee tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Flavor limits 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:59:17.844109 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-e83b17c6-89ac-4de3-8c90-38b441d520ee tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Image limits 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:59:17.844572 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-e83b17c6-89ac-4de3-8c90-38b441d520ee tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Flavor pref 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:59:17.844984 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-e83b17c6-89ac-4de3-8c90-38b441d520ee tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Image pref 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:59:17.845408 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-e83b17c6-89ac-4de3-8c90-38b441d520ee tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:59:17.855916 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e83b17c6-89ac-4de3-8c90-38b441d520ee tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:17.856402 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e83b17c6-89ac-4de3-8c90-38b441d520ee tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:17.856840 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e83b17c6-89ac-4de3-8c90-38b441d520ee tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:17.858103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e83b17c6-89ac-4de3-8c90-38b441d520ee tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:17.858563 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e83b17c6-89ac-4de3-8c90-38b441d520ee tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:17.858991 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e83b17c6-89ac-4de3-8c90-38b441d520ee tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:17.878007 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-e83b17c6-89ac-4de3-8c90-38b441d520ee tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Getting quotas for project 6634173c9d534fca800d394d545a9d0c. Resources: {'ram', 'instances', 'cores'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:59:17.883009 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-e83b17c6-89ac-4de3-8c90-38b441d520ee tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Getting quotas for user 1090c027746845239055973b44207556 and project 6634173c9d534fca800d394d545a9d0c. Resources: {'ram', 'instances', 'cores'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:59:17.936266 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-50f7e48d-0dda-4d5f-84e6-3c0289bd6a76 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:17.944262 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-e83b17c6-89ac-4de3-8c90-38b441d520ee tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Going to run 1 instances... {{(pid=127171) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:59:17.945842 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-50f7e48d-0dda-4d5f-84e6-3c0289bd6a76 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:17.946490 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-e83b17c6-89ac-4de3-8c90-38b441d520ee tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e7e176ec-d197-45be-88b6-a2bca5ed1882',volume_size=None,volume_type=None)] {{(pid=127171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:59:17.947264 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-50f7e48d-0dda-4d5f-84e6-3c0289bd6a76 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:17.948443 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-50f7e48d-0dda-4d5f-84e6-3c0289bd6a76 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.169722 Aug 31 09:59:17.949002 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 473/930] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:59:17 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:59:18.083103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-e83b17c6-89ac-4de3-8c90-38b441d520ee tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.820823 Aug 31 09:59:18.083760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 458/931] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 31 09:59:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 09:59:18.094505 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-0da2b0ba-2ed0-4fe9-b25d-bfd226f89faa tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:18.095213 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-0da2b0ba-2ed0-4fe9-b25d-bfd226f89faa tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:18.149731 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-0da2b0ba-2ed0-4fe9-b25d-bfd226f89faa tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:18.156529 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-0da2b0ba-2ed0-4fe9-b25d-bfd226f89faa tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 200 len: 1093 microversion: 2.1 time: 0.065823 Aug 31 09:59:18.157333 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 474/932] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:18 2022] GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:18.974894 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-38fb6620-d4c8-41f5-85ae-fd5dfa846e9e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:18.974894 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-38fb6620-d4c8-41f5-85ae-fd5dfa846e9e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:18.983006 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38fb6620-d4c8-41f5-85ae-fd5dfa846e9e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:18.983551 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38fb6620-d4c8-41f5-85ae-fd5dfa846e9e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:18.984237 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38fb6620-d4c8-41f5-85ae-fd5dfa846e9e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:18.984886 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38fb6620-d4c8-41f5-85ae-fd5dfa846e9e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:18.985554 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38fb6620-d4c8-41f5-85ae-fd5dfa846e9e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:18.985982 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38fb6620-d4c8-41f5-85ae-fd5dfa846e9e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:19.177043 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-69ab2573-3fb6-4ada-9e98-866129a24073 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:19.177681 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-69ab2573-3fb6-4ada-9e98-866129a24073 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:19.183940 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-69ab2573-3fb6-4ada-9e98-866129a24073 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:19.184672 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-69ab2573-3fb6-4ada-9e98-866129a24073 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:19.185278 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-69ab2573-3fb6-4ada-9e98-866129a24073 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:19.186031 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-69ab2573-3fb6-4ada-9e98-866129a24073 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:19.186553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-69ab2573-3fb6-4ada-9e98-866129a24073 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:19.187269 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-69ab2573-3fb6-4ada-9e98-866129a24073 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:19.278393 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-69ab2573-3fb6-4ada-9e98-866129a24073 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:19.287213 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-69ab2573-3fb6-4ada-9e98-866129a24073 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 200 len: 1191 microversion: 2.1 time: 0.113753 Aug 31 09:59:19.288181 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 475/933] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:19 2022] GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 1191 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:59:19.349004 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-38fb6620-d4c8-41f5-85ae-fd5dfa846e9e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:19.358232 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-38fb6620-d4c8-41f5-85ae-fd5dfa846e9e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:19.360056 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-38fb6620-d4c8-41f5-85ae-fd5dfa846e9e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:19.361278 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-38fb6620-d4c8-41f5-85ae-fd5dfa846e9e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.393755 Aug 31 09:59:19.361893 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 459/934] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:59:18 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:59:20.318148 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-24d0d99e-6ea8-4a58-b0ad-6e6a9a8c8567 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:20.320553 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-24d0d99e-6ea8-4a58-b0ad-6e6a9a8c8567 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:20.328094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-24d0d99e-6ea8-4a58-b0ad-6e6a9a8c8567 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:20.328977 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-24d0d99e-6ea8-4a58-b0ad-6e6a9a8c8567 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:20.329695 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-24d0d99e-6ea8-4a58-b0ad-6e6a9a8c8567 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:20.330667 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-24d0d99e-6ea8-4a58-b0ad-6e6a9a8c8567 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:20.331364 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-24d0d99e-6ea8-4a58-b0ad-6e6a9a8c8567 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:20.332712 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-24d0d99e-6ea8-4a58-b0ad-6e6a9a8c8567 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:20.385705 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-308ad0d9-58e3-4473-8e2e-eff82068175c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:20.386519 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-308ad0d9-58e3-4473-8e2e-eff82068175c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:20.401250 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-308ad0d9-58e3-4473-8e2e-eff82068175c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:20.401770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-308ad0d9-58e3-4473-8e2e-eff82068175c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:20.402416 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-308ad0d9-58e3-4473-8e2e-eff82068175c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:20.403685 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-308ad0d9-58e3-4473-8e2e-eff82068175c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:20.404752 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-308ad0d9-58e3-4473-8e2e-eff82068175c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:20.405773 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-308ad0d9-58e3-4473-8e2e-eff82068175c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:20.415297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-24d0d99e-6ea8-4a58-b0ad-6e6a9a8c8567 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:20.425531 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-24d0d99e-6ea8-4a58-b0ad-6e6a9a8c8567 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 200 len: 1209 microversion: 2.1 time: 0.119861 Aug 31 09:59:20.429285 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 476/935] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:20 2022] GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 1209 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:20.710331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-308ad0d9-58e3-4473-8e2e-eff82068175c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:20.728545 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-308ad0d9-58e3-4473-8e2e-eff82068175c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:20.731692 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-308ad0d9-58e3-4473-8e2e-eff82068175c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:20.733502 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-308ad0d9-58e3-4473-8e2e-eff82068175c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1810 microversion: 2.20 time: 0.351263 Aug 31 09:59:20.734628 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 460/936] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:59:20 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1810 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:59:21.461770 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f1423b42-5a23-46e0-aed0-42cbfce7a16e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:21.462513 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-f1423b42-5a23-46e0-aed0-42cbfce7a16e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:21.464843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=34 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:21.470225 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f1423b42-5a23-46e0-aed0-42cbfce7a16e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:21.470804 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f1423b42-5a23-46e0-aed0-42cbfce7a16e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:21.471331 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f1423b42-5a23-46e0-aed0-42cbfce7a16e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:21.472105 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f1423b42-5a23-46e0-aed0-42cbfce7a16e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:21.472561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f1423b42-5a23-46e0-aed0-42cbfce7a16e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:21.473827 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f1423b42-5a23-46e0-aed0-42cbfce7a16e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:21.703713 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-f1423b42-5a23-46e0-aed0-42cbfce7a16e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:21.713118 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-f1423b42-5a23-46e0-aed0-42cbfce7a16e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 200 len: 1265 microversion: 2.1 time: 0.255322 Aug 31 09:59:21.713660 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 477/937] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:21 2022] GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:21.759796 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-ae3ae085-77b8-4a3d-95b1-27db8cf7f6bf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:21.760558 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-ae3ae085-77b8-4a3d-95b1-27db8cf7f6bf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:21.768044 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ae3ae085-77b8-4a3d-95b1-27db8cf7f6bf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:21.768578 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ae3ae085-77b8-4a3d-95b1-27db8cf7f6bf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:21.769012 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ae3ae085-77b8-4a3d-95b1-27db8cf7f6bf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:21.771172 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ae3ae085-77b8-4a3d-95b1-27db8cf7f6bf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:21.771679 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ae3ae085-77b8-4a3d-95b1-27db8cf7f6bf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:21.772146 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ae3ae085-77b8-4a3d-95b1-27db8cf7f6bf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:22.005240 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-121d8256-a692-4dd5-aef5-d7c2d39f845e req-711b3f87-275a-49b5-805e-782dde910f2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "513a781e-0b66-461a-8d8a-296738d61779", "tag": "bcf607ac-7dab-42c6-8b61-31f31956b33b"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:22.008403 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-ae3ae085-77b8-4a3d-95b1-27db8cf7f6bf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:22.021053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-121d8256-a692-4dd5-aef5-d7c2d39f845e req-711b3f87-275a-49b5-805e-782dde910f2a service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:22.021871 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-121d8256-a692-4dd5-aef5-d7c2d39f845e req-711b3f87-275a-49b5-805e-782dde910f2a service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:22.022535 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-121d8256-a692-4dd5-aef5-d7c2d39f845e req-711b3f87-275a-49b5-805e-782dde910f2a service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:22.044045 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-ae3ae085-77b8-4a3d-95b1-27db8cf7f6bf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:22.045737 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-ae3ae085-77b8-4a3d-95b1-27db8cf7f6bf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:22.049339 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-ae3ae085-77b8-4a3d-95b1-27db8cf7f6bf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1797 microversion: 2.20 time: 0.293514 Aug 31 09:59:22.052019 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 461/938] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 09:59:21 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1797 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:59:22.070813 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-121d8256-a692-4dd5-aef5-d7c2d39f845e req-711b3f87-275a-49b5-805e-782dde910f2a service nova] Creating event network-changed:bcf607ac-7dab-42c6-8b61-31f31956b33b for instance 513a781e-0b66-461a-8d8a-296738d61779 on hv-cinder-84496 Aug 31 09:59:22.080288 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-121d8256-a692-4dd5-aef5-d7c2d39f845e req-711b3f87-275a-49b5-805e-782dde910f2a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080230 Aug 31 09:59:22.081207 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 478/939] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:59:22.735123 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-ecf098b0-075f-4697-b728-1e7c05ea3fdc tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:22.735722 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-ecf098b0-075f-4697-b728-1e7c05ea3fdc tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:22.737723 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:22.743413 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ecf098b0-075f-4697-b728-1e7c05ea3fdc tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:22.743891 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ecf098b0-075f-4697-b728-1e7c05ea3fdc tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:22.744317 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ecf098b0-075f-4697-b728-1e7c05ea3fdc tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:22.745000 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ecf098b0-075f-4697-b728-1e7c05ea3fdc tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:22.745485 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ecf098b0-075f-4697-b728-1e7c05ea3fdc tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:22.745899 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ecf098b0-075f-4697-b728-1e7c05ea3fdc tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:22.885220 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-ecf098b0-075f-4697-b728-1e7c05ea3fdc tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:22.893899 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-ecf098b0-075f-4697-b728-1e7c05ea3fdc tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 200 len: 1265 microversion: 2.1 time: 0.162483 Aug 31 09:59:22.895070 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 462/940] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:22 2022] GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:23.915902 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-2ab87057-db36-43e6-bcaf-05eca609a3d7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:23.916660 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-2ab87057-db36-43e6-bcaf-05eca609a3d7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:23.923588 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2ab87057-db36-43e6-bcaf-05eca609a3d7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:23.924057 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2ab87057-db36-43e6-bcaf-05eca609a3d7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:23.924490 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2ab87057-db36-43e6-bcaf-05eca609a3d7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:23.925188 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2ab87057-db36-43e6-bcaf-05eca609a3d7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:23.925703 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2ab87057-db36-43e6-bcaf-05eca609a3d7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:23.926196 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2ab87057-db36-43e6-bcaf-05eca609a3d7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:23.928929 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=90 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:24.069166 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-2ab87057-db36-43e6-bcaf-05eca609a3d7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:24.077290 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-2ab87057-db36-43e6-bcaf-05eca609a3d7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 200 len: 1265 microversion: 2.1 time: 0.165544 Aug 31 09:59:24.077915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 479/941] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:23 2022] GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:25.100084 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-6798da53-0558-4341-8e00-cee123a4ff70 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:25.100803 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-6798da53-0558-4341-8e00-cee123a4ff70 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:25.107419 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6798da53-0558-4341-8e00-cee123a4ff70 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:25.107911 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6798da53-0558-4341-8e00-cee123a4ff70 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:25.108344 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6798da53-0558-4341-8e00-cee123a4ff70 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:25.109053 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6798da53-0558-4341-8e00-cee123a4ff70 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:25.109532 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6798da53-0558-4341-8e00-cee123a4ff70 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:25.109955 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6798da53-0558-4341-8e00-cee123a4ff70 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:25.256571 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-6798da53-0558-4341-8e00-cee123a4ff70 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:25.264626 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-6798da53-0558-4341-8e00-cee123a4ff70 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 200 len: 1265 microversion: 2.1 time: 0.169263 Aug 31 09:59:25.265204 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 463/942] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:25 2022] GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:26.287006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-1503f8a4-0d2b-48d5-a30a-a924c73892a7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:26.287600 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-1503f8a4-0d2b-48d5-a30a-a924c73892a7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:26.296568 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1503f8a4-0d2b-48d5-a30a-a924c73892a7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:26.297061 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1503f8a4-0d2b-48d5-a30a-a924c73892a7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:26.297530 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1503f8a4-0d2b-48d5-a30a-a924c73892a7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:26.298235 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1503f8a4-0d2b-48d5-a30a-a924c73892a7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:26.298687 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1503f8a4-0d2b-48d5-a30a-a924c73892a7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:26.299107 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1503f8a4-0d2b-48d5-a30a-a924c73892a7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:26.454137 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-1503f8a4-0d2b-48d5-a30a-a924c73892a7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:26.462543 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-1503f8a4-0d2b-48d5-a30a-a924c73892a7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 200 len: 1265 microversion: 2.1 time: 0.180215 Aug 31 09:59:26.463170 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 480/943] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:26 2022] GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:59:27.483648 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-7d6f9bf4-f920-4a73-8565-490816d41d8e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:27.484193 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-7d6f9bf4-f920-4a73-8565-490816d41d8e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:27.492411 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7d6f9bf4-f920-4a73-8565-490816d41d8e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:27.492907 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7d6f9bf4-f920-4a73-8565-490816d41d8e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:27.493348 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7d6f9bf4-f920-4a73-8565-490816d41d8e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:27.494097 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7d6f9bf4-f920-4a73-8565-490816d41d8e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:27.494555 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7d6f9bf4-f920-4a73-8565-490816d41d8e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:27.494993 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7d6f9bf4-f920-4a73-8565-490816d41d8e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:27.765968 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7d6f9bf4-f920-4a73-8565-490816d41d8e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:27.774882 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-7d6f9bf4-f920-4a73-8565-490816d41d8e tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 200 len: 1265 microversion: 2.1 time: 0.295218 Aug 31 09:59:27.775469 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 464/944] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:27 2022] GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 1265 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:28.805017 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a53ea383-8e8c-48df-a70b-085ad8b87dc7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:28.805727 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-a53ea383-8e8c-48df-a70b-085ad8b87dc7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:28.808180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=2 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:28.813669 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a53ea383-8e8c-48df-a70b-085ad8b87dc7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:28.814151 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a53ea383-8e8c-48df-a70b-085ad8b87dc7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:28.814585 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a53ea383-8e8c-48df-a70b-085ad8b87dc7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:28.815270 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a53ea383-8e8c-48df-a70b-085ad8b87dc7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:28.815711 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a53ea383-8e8c-48df-a70b-085ad8b87dc7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:28.816120 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a53ea383-8e8c-48df-a70b-085ad8b87dc7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:28.992094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-a53ea383-8e8c-48df-a70b-085ad8b87dc7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:29.000868 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a53ea383-8e8c-48df-a70b-085ad8b87dc7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 200 len: 1265 microversion: 2.1 time: 0.200741 Aug 31 09:59:29.001511 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 481/945] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:28 2022] GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:59:30.028507 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c08f0042-ad72-4f39-911b-592cf45c10ce tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:30.029573 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c08f0042-ad72-4f39-911b-592cf45c10ce tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:30.032672 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=2 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:30.033878 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=6 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:30.041664 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c08f0042-ad72-4f39-911b-592cf45c10ce tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:30.042149 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c08f0042-ad72-4f39-911b-592cf45c10ce tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:30.042577 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c08f0042-ad72-4f39-911b-592cf45c10ce tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:30.043278 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c08f0042-ad72-4f39-911b-592cf45c10ce tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:30.043727 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c08f0042-ad72-4f39-911b-592cf45c10ce tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:30.044146 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c08f0042-ad72-4f39-911b-592cf45c10ce tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:30.255197 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c08f0042-ad72-4f39-911b-592cf45c10ce tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:30.263553 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c08f0042-ad72-4f39-911b-592cf45c10ce tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 200 len: 1265 microversion: 2.1 time: 0.242674 Aug 31 09:59:30.264154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 465/946] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:30 2022] GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:31.284516 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-160de425-0840-4a47-9442-5980e104dc9a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:31.285196 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-160de425-0840-4a47-9442-5980e104dc9a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:31.296400 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-160de425-0840-4a47-9442-5980e104dc9a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:31.297084 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-160de425-0840-4a47-9442-5980e104dc9a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:31.298739 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-160de425-0840-4a47-9442-5980e104dc9a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:31.299468 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-160de425-0840-4a47-9442-5980e104dc9a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:31.299930 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-160de425-0840-4a47-9442-5980e104dc9a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:31.300354 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-160de425-0840-4a47-9442-5980e104dc9a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:31.465212 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-160de425-0840-4a47-9442-5980e104dc9a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:31.477758 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-160de425-0840-4a47-9442-5980e104dc9a tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 200 len: 1265 microversion: 2.1 time: 0.196784 Aug 31 09:59:31.478663 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 482/947] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:31 2022] GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:32.500777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-48d4417a-d453-4ccb-8b3d-f120754a4c74 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:32.501617 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-48d4417a-d453-4ccb-8b3d-f120754a4c74 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:32.508931 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-48d4417a-d453-4ccb-8b3d-f120754a4c74 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:32.509453 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-48d4417a-d453-4ccb-8b3d-f120754a4c74 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:32.509892 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-48d4417a-d453-4ccb-8b3d-f120754a4c74 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:32.510600 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-48d4417a-d453-4ccb-8b3d-f120754a4c74 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:32.511083 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-48d4417a-d453-4ccb-8b3d-f120754a4c74 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:32.511502 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-48d4417a-d453-4ccb-8b3d-f120754a4c74 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:32.658087 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-48d4417a-d453-4ccb-8b3d-f120754a4c74 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:32.666825 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-48d4417a-d453-4ccb-8b3d-f120754a4c74 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 200 len: 1265 microversion: 2.1 time: 0.169936 Aug 31 09:59:32.667684 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 466/948] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:32 2022] GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:33.690539 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-32159a08-414f-4246-85e1-8bb75ca9db19 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:33.692148 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-32159a08-414f-4246-85e1-8bb75ca9db19 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:33.699030 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-32159a08-414f-4246-85e1-8bb75ca9db19 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:33.699515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-32159a08-414f-4246-85e1-8bb75ca9db19 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:33.699944 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-32159a08-414f-4246-85e1-8bb75ca9db19 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:33.700647 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-32159a08-414f-4246-85e1-8bb75ca9db19 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:33.701094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-32159a08-414f-4246-85e1-8bb75ca9db19 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:33.701535 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-32159a08-414f-4246-85e1-8bb75ca9db19 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:33.890180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-32159a08-414f-4246-85e1-8bb75ca9db19 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:33.899051 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-32159a08-414f-4246-85e1-8bb75ca9db19 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 200 len: 1265 microversion: 2.1 time: 0.214504 Aug 31 09:59:33.899640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 483/949] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:33 2022] GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:34.920859 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-816f3cfc-b0b0-475e-818c-23cff80f4d58 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:34.921503 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-816f3cfc-b0b0-475e-818c-23cff80f4d58 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:34.930426 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-816f3cfc-b0b0-475e-818c-23cff80f4d58 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:34.931316 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-816f3cfc-b0b0-475e-818c-23cff80f4d58 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:34.932103 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-816f3cfc-b0b0-475e-818c-23cff80f4d58 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:34.933684 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-816f3cfc-b0b0-475e-818c-23cff80f4d58 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:34.934278 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-816f3cfc-b0b0-475e-818c-23cff80f4d58 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:34.935064 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-816f3cfc-b0b0-475e-818c-23cff80f4d58 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:35.090538 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-816f3cfc-b0b0-475e-818c-23cff80f4d58 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:35.104583 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-816f3cfc-b0b0-475e-818c-23cff80f4d58 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 200 len: 1265 microversion: 2.1 time: 0.187557 Aug 31 09:59:35.105173 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 467/950] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:34 2022] GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:36.125833 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-0770287d-aa72-471c-9931-d04d621f4bbf tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:36.126430 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-0770287d-aa72-471c-9931-d04d621f4bbf tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:36.133053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0770287d-aa72-471c-9931-d04d621f4bbf tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:36.133576 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0770287d-aa72-471c-9931-d04d621f4bbf tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:36.134011 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0770287d-aa72-471c-9931-d04d621f4bbf tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:36.134695 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0770287d-aa72-471c-9931-d04d621f4bbf tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:36.135141 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0770287d-aa72-471c-9931-d04d621f4bbf tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:36.135557 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0770287d-aa72-471c-9931-d04d621f4bbf tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:36.268667 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-0770287d-aa72-471c-9931-d04d621f4bbf tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:36.277224 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-0770287d-aa72-471c-9931-d04d621f4bbf tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 200 len: 1265 microversion: 2.1 time: 0.155273 Aug 31 09:59:36.277823 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 484/951] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:36 2022] GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:36.522619 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-d7e7dbb6-064d-427e-9410-2a94c4b8c7d1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:36.523159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-d7e7dbb6-064d-427e-9410-2a94c4b8c7d1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:36.529626 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d7e7dbb6-064d-427e-9410-2a94c4b8c7d1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:36.530137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d7e7dbb6-064d-427e-9410-2a94c4b8c7d1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:36.530561 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d7e7dbb6-064d-427e-9410-2a94c4b8c7d1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:36.531274 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d7e7dbb6-064d-427e-9410-2a94c4b8c7d1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:36.531737 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d7e7dbb6-064d-427e-9410-2a94c4b8c7d1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:36.532149 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d7e7dbb6-064d-427e-9410-2a94c4b8c7d1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:36.557649 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-d7e7dbb6-064d-427e-9410-2a94c4b8c7d1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094/ips" status: 200 len: 150 microversion: 2.1 time: 0.038879 Aug 31 09:59:36.558153 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 468/952] 10.222.0.13 () {58 vars in 1248 bytes} [Wed Aug 31 09:59:36 2022] GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:59:37.298647 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-ebbb4b2a-82cd-4fcf-8478-cb2580d355b2 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:37.299258 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-ebbb4b2a-82cd-4fcf-8478-cb2580d355b2 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:37.306953 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ebbb4b2a-82cd-4fcf-8478-cb2580d355b2 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:37.307431 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ebbb4b2a-82cd-4fcf-8478-cb2580d355b2 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:37.307891 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ebbb4b2a-82cd-4fcf-8478-cb2580d355b2 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:37.308582 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ebbb4b2a-82cd-4fcf-8478-cb2580d355b2 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:37.309032 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ebbb4b2a-82cd-4fcf-8478-cb2580d355b2 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:37.309491 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ebbb4b2a-82cd-4fcf-8478-cb2580d355b2 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:37.441269 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-ebbb4b2a-82cd-4fcf-8478-cb2580d355b2 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:37.449300 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-ebbb4b2a-82cd-4fcf-8478-cb2580d355b2 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 200 len: 1265 microversion: 2.1 time: 0.154431 Aug 31 09:59:37.449910 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 485/953] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:37 2022] GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:37.899019 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-e9e7f19f-dd40-4785-a496-c10797894c3b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2705f43c-c312-44fa-a33a-a20e9116c0e6"}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:37.901499 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-e9e7f19f-dd40-4785-a496-c10797894c3b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:37.908143 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e9e7f19f-dd40-4785-a496-c10797894c3b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:37.908619 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e9e7f19f-dd40-4785-a496-c10797894c3b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:37.909048 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e9e7f19f-dd40-4785-a496-c10797894c3b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:37.909785 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e9e7f19f-dd40-4785-a496-c10797894c3b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:37.911538 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e9e7f19f-dd40-4785-a496-c10797894c3b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:37.911966 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e9e7f19f-dd40-4785-a496-c10797894c3b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:38.189890 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-e9e7f19f-dd40-4785-a496-c10797894c3b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "POST /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295765 Aug 31 09:59:38.190538 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 469/954] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 31 09:59:37 2022] POST /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:59:38.469909 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-aa85add0-389d-4f65-935b-059b04534ef9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:38.470621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-aa85add0-389d-4f65-935b-059b04534ef9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:38.477158 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-aa85add0-389d-4f65-935b-059b04534ef9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:38.477673 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-aa85add0-389d-4f65-935b-059b04534ef9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:38.478097 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-aa85add0-389d-4f65-935b-059b04534ef9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:38.478979 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-aa85add0-389d-4f65-935b-059b04534ef9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:38.479457 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-aa85add0-389d-4f65-935b-059b04534ef9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:38.479831 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-aa85add0-389d-4f65-935b-059b04534ef9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:38.592414 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-1c3610de-0a12-4372-9200-ab4f282c052f req-09dc5628-4855-4461-80cf-ac3c05561b29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513a781e-0b66-461a-8d8a-296738d61779", "name": "network-vif-plugged", "status": "completed", "tag": "bcf607ac-7dab-42c6-8b61-31f31956b33b"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:38.605826 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-1c3610de-0a12-4372-9200-ab4f282c052f req-09dc5628-4855-4461-80cf-ac3c05561b29 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:38.606326 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-1c3610de-0a12-4372-9200-ab4f282c052f req-09dc5628-4855-4461-80cf-ac3c05561b29 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:38.606824 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-1c3610de-0a12-4372-9200-ab4f282c052f req-09dc5628-4855-4461-80cf-ac3c05561b29 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:38.619605 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-1c3610de-0a12-4372-9200-ab4f282c052f req-09dc5628-4855-4461-80cf-ac3c05561b29 service nova] Creating event network-vif-plugged:bcf607ac-7dab-42c6-8b61-31f31956b33b for instance 513a781e-0b66-461a-8d8a-296738d61779 on hv-cinder-84496 Aug 31 09:59:38.624793 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-1c3610de-0a12-4372-9200-ab4f282c052f req-09dc5628-4855-4461-80cf-ac3c05561b29 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037376 Aug 31 09:59:38.625887 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-aa85add0-389d-4f65-935b-059b04534ef9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:38.626126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 470/955] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:59:38.635316 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-aa85add0-389d-4f65-935b-059b04534ef9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 200 len: 1265 microversion: 2.1 time: 0.169207 Aug 31 09:59:38.636117 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 486/956] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:38 2022] GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:39.657354 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-b89b5789-46e7-49d1-9c9c-9b43263de7cf tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:39.658012 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-b89b5789-46e7-49d1-9c9c-9b43263de7cf tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:39.665351 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b89b5789-46e7-49d1-9c9c-9b43263de7cf tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:39.665884 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b89b5789-46e7-49d1-9c9c-9b43263de7cf tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:39.666322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b89b5789-46e7-49d1-9c9c-9b43263de7cf tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:39.667020 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b89b5789-46e7-49d1-9c9c-9b43263de7cf tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:39.667474 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b89b5789-46e7-49d1-9c9c-9b43263de7cf tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:39.667899 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b89b5789-46e7-49d1-9c9c-9b43263de7cf tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:39.798101 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b89b5789-46e7-49d1-9c9c-9b43263de7cf tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:39.806892 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-b89b5789-46e7-49d1-9c9c-9b43263de7cf tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 200 len: 1265 microversion: 2.1 time: 0.154412 Aug 31 09:59:39.807462 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 471/957] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:39 2022] GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:40.828046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-8c43b08b-4ad0-4ad5-b86c-89cc94e866a7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:40.828691 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-8c43b08b-4ad0-4ad5-b86c-89cc94e866a7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:40.835760 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8c43b08b-4ad0-4ad5-b86c-89cc94e866a7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:40.836237 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8c43b08b-4ad0-4ad5-b86c-89cc94e866a7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:40.836663 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8c43b08b-4ad0-4ad5-b86c-89cc94e866a7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:40.837350 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8c43b08b-4ad0-4ad5-b86c-89cc94e866a7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:40.837818 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8c43b08b-4ad0-4ad5-b86c-89cc94e866a7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:40.838236 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8c43b08b-4ad0-4ad5-b86c-89cc94e866a7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:40.974616 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-8c43b08b-4ad0-4ad5-b86c-89cc94e866a7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:40.982586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-8c43b08b-4ad0-4ad5-b86c-89cc94e866a7 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 200 len: 1450 microversion: 2.1 time: 0.158571 Aug 31 09:59:40.983158 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 487/958] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:40 2022] GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:41.003393 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-b10ea911-559e-496e-ac00-b3c0c6e21807 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:41.004088 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-b10ea911-559e-496e-ac00-b3c0c6e21807 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:41.010791 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b10ea911-559e-496e-ac00-b3c0c6e21807 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:41.011277 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b10ea911-559e-496e-ac00-b3c0c6e21807 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:41.011715 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b10ea911-559e-496e-ac00-b3c0c6e21807 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:41.012591 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b10ea911-559e-496e-ac00-b3c0c6e21807 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:41.013248 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b10ea911-559e-496e-ac00-b3c0c6e21807 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:41.013783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b10ea911-559e-496e-ac00-b3c0c6e21807 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:41.149935 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b10ea911-559e-496e-ac00-b3c0c6e21807 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:41.152254 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:41.159305 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-b10ea911-559e-496e-ac00-b3c0c6e21807 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 200 len: 1450 microversion: 2.1 time: 0.159800 Aug 31 09:59:41.160447 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 472/959] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:40 2022] GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 1450 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:43.285305 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-15157e55-ae2b-498a-b628-67f6d9562dd8 req-0ec0d268-5e58-42bc-bade-b144687e177c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "513a781e-0b66-461a-8d8a-296738d61779", "tag": "bcf607ac-7dab-42c6-8b61-31f31956b33b"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:43.295114 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-15157e55-ae2b-498a-b628-67f6d9562dd8 req-0ec0d268-5e58-42bc-bade-b144687e177c service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:43.295584 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-15157e55-ae2b-498a-b628-67f6d9562dd8 req-0ec0d268-5e58-42bc-bade-b144687e177c service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:43.296004 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-15157e55-ae2b-498a-b628-67f6d9562dd8 req-0ec0d268-5e58-42bc-bade-b144687e177c service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:43.308478 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-15157e55-ae2b-498a-b628-67f6d9562dd8 req-0ec0d268-5e58-42bc-bade-b144687e177c service nova] Creating event network-changed:bcf607ac-7dab-42c6-8b61-31f31956b33b for instance 513a781e-0b66-461a-8d8a-296738d61779 on hv-cinder-84496 Aug 31 09:59:43.314032 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-15157e55-ae2b-498a-b628-67f6d9562dd8 req-0ec0d268-5e58-42bc-bade-b144687e177c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156245 Aug 31 09:59:43.314635 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 488/960] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:59:46.892999 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-fbe7656c-eef5-4cb3-a77a-acb7478ddfdb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:46.893570 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-fbe7656c-eef5-4cb3-a77a-acb7478ddfdb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:46.900398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fbe7656c-eef5-4cb3-a77a-acb7478ddfdb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:46.900871 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fbe7656c-eef5-4cb3-a77a-acb7478ddfdb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:46.901298 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fbe7656c-eef5-4cb3-a77a-acb7478ddfdb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:46.901998 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fbe7656c-eef5-4cb3-a77a-acb7478ddfdb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:46.902443 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fbe7656c-eef5-4cb3-a77a-acb7478ddfdb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:46.903288 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fbe7656c-eef5-4cb3-a77a-acb7478ddfdb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:46.987087 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.objects.instance [None req-fbe7656c-eef5-4cb3-a77a-acb7478ddfdb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lazy-loading 'services' on Instance uuid 4e42a48f-9abd-449f-8f42-f91ce8b40094 {{(pid=127171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:59:47.063050 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-fbe7656c-eef5-4cb3-a77a-acb7478ddfdb tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094/os-volume_attachments/2705f43c-c312-44fa-a33a-a20e9116c0e6" status: 202 len: 0 microversion: 2.1 time: 0.174253 Aug 31 09:59:47.063655 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 473/961] 10.222.0.13 () {58 vars in 1416 bytes} [Wed Aug 31 09:59:46 2022] DELETE /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094/os-volume_attachments/2705f43c-c312-44fa-a33a-a20e9116c0e6 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:59:47.073672 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-59ef7e54-15ed-4b11-bfd8-90a52a4ee274 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:47.076013 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-59ef7e54-15ed-4b11-bfd8-90a52a4ee274 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:47.083531 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-59ef7e54-15ed-4b11-bfd8-90a52a4ee274 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:47.083959 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-59ef7e54-15ed-4b11-bfd8-90a52a4ee274 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:47.084397 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-59ef7e54-15ed-4b11-bfd8-90a52a4ee274 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:47.085975 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-59ef7e54-15ed-4b11-bfd8-90a52a4ee274 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:47.085975 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-59ef7e54-15ed-4b11-bfd8-90a52a4ee274 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:47.086281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-59ef7e54-15ed-4b11-bfd8-90a52a4ee274 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:47.121534 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-59ef7e54-15ed-4b11-bfd8-90a52a4ee274 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052697 Aug 31 09:59:47.122116 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 489/962] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 31 09:59:47 2022] GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:59:48.135347 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-f8667f0c-93c1-4d41-bf70-d957f698329b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:48.137663 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-f8667f0c-93c1-4d41-bf70-d957f698329b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:48.145093 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f8667f0c-93c1-4d41-bf70-d957f698329b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:48.145605 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f8667f0c-93c1-4d41-bf70-d957f698329b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:48.146037 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f8667f0c-93c1-4d41-bf70-d957f698329b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:48.146718 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f8667f0c-93c1-4d41-bf70-d957f698329b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:48.147161 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f8667f0c-93c1-4d41-bf70-d957f698329b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:48.147576 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f8667f0c-93c1-4d41-bf70-d957f698329b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:48.177227 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-f8667f0c-93c1-4d41-bf70-d957f698329b tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046145 Aug 31 09:59:48.177803 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 474/963] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 31 09:59:48 2022] GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 09:59:48.240332 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-753b2eb0-2055-424e-bb15-2a5972a9c3ba tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:48.240837 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-753b2eb0-2055-424e-bb15-2a5972a9c3ba tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:48.247743 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-753b2eb0-2055-424e-bb15-2a5972a9c3ba tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:48.248226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-753b2eb0-2055-424e-bb15-2a5972a9c3ba tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:48.248668 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-753b2eb0-2055-424e-bb15-2a5972a9c3ba tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:48.249405 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-753b2eb0-2055-424e-bb15-2a5972a9c3ba tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:48.249876 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-753b2eb0-2055-424e-bb15-2a5972a9c3ba tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:48.250302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-753b2eb0-2055-424e-bb15-2a5972a9c3ba tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:48.276074 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-753b2eb0-2055-424e-bb15-2a5972a9c3ba tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Going to try to terminate instance {{(pid=127170) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:59:48.355877 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-753b2eb0-2055-424e-bb15-2a5972a9c3ba tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094" status: 204 len: 0 microversion: 2.1 time: 0.119065 Aug 31 09:59:48.356582 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 490/964] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 09:59:48 2022] DELETE /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:59:48.366292 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-4402c5a0-fa29-4e5e-9bb3-b73b2040046f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:48.366977 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-4402c5a0-fa29-4e5e-9bb3-b73b2040046f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:48.373605 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4402c5a0-fa29-4e5e-9bb3-b73b2040046f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:48.374084 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4402c5a0-fa29-4e5e-9bb3-b73b2040046f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:48.374510 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4402c5a0-fa29-4e5e-9bb3-b73b2040046f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:48.375188 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4402c5a0-fa29-4e5e-9bb3-b73b2040046f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:48.375631 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4402c5a0-fa29-4e5e-9bb3-b73b2040046f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:48.376048 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4402c5a0-fa29-4e5e-9bb3-b73b2040046f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:48.512236 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-4402c5a0-fa29-4e5e-9bb3-b73b2040046f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:48.520610 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-4402c5a0-fa29-4e5e-9bb3-b73b2040046f tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094" status: 200 len: 1682 microversion: 2.1 time: 0.158966 Aug 31 09:59:48.521169 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 475/965] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:48 2022] GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:49.542534 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-ddd06495-a5c6-4653-9845-f9c559018f0a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:49.543152 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-ddd06495-a5c6-4653-9845-f9c559018f0a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:49.549666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ddd06495-a5c6-4653-9845-f9c559018f0a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:49.550148 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ddd06495-a5c6-4653-9845-f9c559018f0a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:49.550763 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ddd06495-a5c6-4653-9845-f9c559018f0a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:49.551654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ddd06495-a5c6-4653-9845-f9c559018f0a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:49.552100 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ddd06495-a5c6-4653-9845-f9c559018f0a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:49.552526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ddd06495-a5c6-4653-9845-f9c559018f0a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:49.682731 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-ddd06495-a5c6-4653-9845-f9c559018f0a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:49.690519 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-ddd06495-a5c6-4653-9845-f9c559018f0a tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094" status: 200 len: 1682 microversion: 2.1 time: 0.152259 Aug 31 09:59:49.692007 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 491/966] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:49 2022] GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:50.712757 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-8713bfa4-1e58-402b-99cf-b8c9830353a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:50.713356 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-8713bfa4-1e58-402b-99cf-b8c9830353a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:50.720415 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8713bfa4-1e58-402b-99cf-b8c9830353a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:50.720415 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8713bfa4-1e58-402b-99cf-b8c9830353a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:50.720705 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8713bfa4-1e58-402b-99cf-b8c9830353a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:50.721409 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8713bfa4-1e58-402b-99cf-b8c9830353a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:50.721945 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8713bfa4-1e58-402b-99cf-b8c9830353a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:50.722781 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8713bfa4-1e58-402b-99cf-b8c9830353a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:50.950347 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-8713bfa4-1e58-402b-99cf-b8c9830353a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:50.960076 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-8713bfa4-1e58-402b-99cf-b8c9830353a1 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094" status: 200 len: 1682 microversion: 2.1 time: 0.251216 Aug 31 09:59:50.960696 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 476/967] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:50 2022] GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094 => generated 1682 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:51.478177 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-fcc9f922-f7aa-45fe-86c5-5073f603bac1 req-5a093809-6d97-4836-ba50-016a73c6bf05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e42a48f-9abd-449f-8f42-f91ce8b40094", "name": "network-vif-deleted", "tag": "b9a004e1-e2d5-4351-9de6-8cf4a7822bc5"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:51.483168 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:51.490070 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-fcc9f922-f7aa-45fe-86c5-5073f603bac1 req-5a093809-6d97-4836-ba50-016a73c6bf05 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:51.490876 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-fcc9f922-f7aa-45fe-86c5-5073f603bac1 req-5a093809-6d97-4836-ba50-016a73c6bf05 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:51.491300 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-fcc9f922-f7aa-45fe-86c5-5073f603bac1 req-5a093809-6d97-4836-ba50-016a73c6bf05 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:51.505164 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-fcc9f922-f7aa-45fe-86c5-5073f603bac1 req-5a093809-6d97-4836-ba50-016a73c6bf05 service nova] Creating event network-vif-deleted:b9a004e1-e2d5-4351-9de6-8cf4a7822bc5 for instance 4e42a48f-9abd-449f-8f42-f91ce8b40094 on hv-cinder-84496 Aug 31 09:59:51.510384 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-fcc9f922-f7aa-45fe-86c5-5073f603bac1 req-5a093809-6d97-4836-ba50-016a73c6bf05 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099991 Aug 31 09:59:51.511609 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 492/968] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 09:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:59:51.983354 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-5046edbb-3dc2-4e79-9445-43694145eb0d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:51.983966 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-5046edbb-3dc2-4e79-9445-43694145eb0d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:51.991354 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5046edbb-3dc2-4e79-9445-43694145eb0d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:51.991842 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5046edbb-3dc2-4e79-9445-43694145eb0d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:51.992273 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5046edbb-3dc2-4e79-9445-43694145eb0d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:51.992965 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5046edbb-3dc2-4e79-9445-43694145eb0d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:51.993441 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5046edbb-3dc2-4e79-9445-43694145eb0d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:51.993863 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5046edbb-3dc2-4e79-9445-43694145eb0d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:52.029841 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5046edbb-3dc2-4e79-9445-43694145eb0d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:52.030322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5046edbb-3dc2-4e79-9445-43694145eb0d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:52.030751 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5046edbb-3dc2-4e79-9445-43694145eb0d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:52.031204 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.objects.instance [None req-5046edbb-3dc2-4e79-9445-43694145eb0d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lazy-loading 'fault' on Instance uuid 4e42a48f-9abd-449f-8f42-f91ce8b40094 {{(pid=127171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:59:52.085445 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-5046edbb-3dc2-4e79-9445-43694145eb0d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b4233e5f0e41bf99b3fb3f5f6229c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed9143757584694a5139ada8dbd5570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:52.096474 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-5046edbb-3dc2-4e79-9445-43694145eb0d tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094" status: 200 len: 1331 microversion: 2.1 time: 0.116853 Aug 31 09:59:52.098138 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 477/969] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:51 2022] GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094 => generated 1331 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:53.120287 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f5a9ae67-7969-4eda-95bd-5271445dcf1c tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:53.120980 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-f5a9ae67-7969-4eda-95bd-5271445dcf1c tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:53.127229 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f5a9ae67-7969-4eda-95bd-5271445dcf1c tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:53.127707 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f5a9ae67-7969-4eda-95bd-5271445dcf1c tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:53.128137 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f5a9ae67-7969-4eda-95bd-5271445dcf1c tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:53.129746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f5a9ae67-7969-4eda-95bd-5271445dcf1c tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:53.130202 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f5a9ae67-7969-4eda-95bd-5271445dcf1c tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:53.130623 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f5a9ae67-7969-4eda-95bd-5271445dcf1c tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:53.143724 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-f5a9ae67-7969-4eda-95bd-5271445dcf1c tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] HTTP exception thrown: Instance 4e42a48f-9abd-449f-8f42-f91ce8b40094 could not be found. Aug 31 09:59:53.146323 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f5a9ae67-7969-4eda-95bd-5271445dcf1c tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Request method failure captured: Aug 31 09:59:53.146323 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094 HTTP/1.1 Aug 31 09:59:53.146323 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 09:59:53.146323 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 09:59:53.146323 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 09:59:53.146323 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 09:59:53.146323 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 09:59:53.146323 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 09:59:53.146323 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 09:59:53.146323 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 09:59:53.146323 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy6sN1dq8bwJPS_jK4T_eY89XY484BzJuR68dlflJc6VvZgYE_FtzceTKQW1kiHPXFi1h_ZI_jnv2y63cuWWAmCtmFfvmGj6lmJqh816MDH_lQt4Qw0fH63qKXCoQUNRNnOITiuKYSI6cXUru5wJe9L6kAmQya7lhE-_AhxPVCJKUbM Aug 31 09:59:53.146323 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 09:59:53.146323 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 09:59:53.146323 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 09:59:53.146323 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 09:59:53.146323 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 09:59:53.146323 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 09:59:53.146323 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:59:53.146323 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:53.146323 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 09:59:53.146323 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 09:59:53.147735 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5ed9143757584694a5139ada8dbd5570"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:59:53.147735 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:53.147735 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:59:53.147735 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:53.147735 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:59:53.147735 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 09:59:53.147735 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 09:59:53.147735 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: 25b4233e5f0e41bf99b3fb3f5f6229c9 Aug 31 09:59:53.147735 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:59:53.147735 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 09:59:53.147735 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Instance 4e42a48f-9abd-449f-8f42-f91ce8b40094 could not be found. Aug 31 09:59:53.147735 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': '4e42a48f-9abd-449f-8f42-f91ce8b40094'} Aug 31 09:59:53.149297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:59:53.149297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:53.149297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:59:53.149297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:59:53.149297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:59:53.149297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:59:53.149297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:59:53.149297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:59:53.149297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:59:53.149297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:59:53.149297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e42a48f-9abd-449f-8f42-f91ce8b40094 could not be found. Aug 31 09:59:53.149297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:59:53.149297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:59:53.149297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:59:53.149297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:53.149297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:59:53.149297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:59:53.149297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:59:53.149297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:59:53.149297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:59:53.151034 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:59:53.151034 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:59:53.151034 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:59:53.151034 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:59:53.151034 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:59:53.151034 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:59:53.151034 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:59:53.151034 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e42a48f-9abd-449f-8f42-f91ce8b40094 could not be found. Aug 31 09:59:53.151034 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:59:53.151034 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:59:53.151034 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:59:53.151034 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:53.151034 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:59:53.151034 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:59:53.151034 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:59:53.151034 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:59:53.151034 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e42a48f-9abd-449f-8f42-f91ce8b40094 could not be found. Aug 31 09:59:53.151034 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:59:53.152797 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f5a9ae67-7969-4eda-95bd-5271445dcf1c tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Returning 404 to user: Instance 4e42a48f-9abd-449f-8f42-f91ce8b40094 could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:59:53.152797 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-f5a9ae67-7969-4eda-95bd-5271445dcf1c tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094" status: 404 len: 111 microversion: 2.1 time: 0.032554 Aug 31 09:59:53.152797 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 493/970] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:53 2022] GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:59:53.158538 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-5e282bf3-005f-4436-943f-cfddf1c244f7 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '.version_select at 0x7f5503d31af0>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:53.166352 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=34 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:53.178654 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-5e282bf3-005f-4436-943f-cfddf1c244f7 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1905289023" status: 202 len: 0 microversion: 2.1 time: 0.024400 Aug 31 09:59:53.179240 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 478/971] 10.222.0.13 () {58 vars in 1221 bytes} [Wed Aug 31 09:59:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1905289023 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:59:54.933013 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-c8d38cc4-ba01-4fc9-9d01-c008579075fe tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:54.933571 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-c8d38cc4-ba01-4fc9-9d01-c008579075fe tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:54.939840 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8d38cc4-ba01-4fc9-9d01-c008579075fe tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:54.940304 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8d38cc4-ba01-4fc9-9d01-c008579075fe tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:54.940759 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8d38cc4-ba01-4fc9-9d01-c008579075fe tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:54.941577 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8d38cc4-ba01-4fc9-9d01-c008579075fe tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:54.941952 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8d38cc4-ba01-4fc9-9d01-c008579075fe tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:54.942359 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8d38cc4-ba01-4fc9-9d01-c008579075fe tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:54.944940 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:54.957608 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-c8d38cc4-ba01-4fc9-9d01-c008579075fe tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] HTTP exception thrown: Instance 4e42a48f-9abd-449f-8f42-f91ce8b40094 could not be found. Aug 31 09:59:54.959125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-c8d38cc4-ba01-4fc9-9d01-c008579075fe tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Request method failure captured: Aug 31 09:59:54.959125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: DELETE /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094 HTTP/1.1 Aug 31 09:59:54.959125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 09:59:54.959125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 09:59:54.959125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 09:59:54.959125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 09:59:54.959125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 09:59:54.959125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 09:59:54.959125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 09:59:54.959125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 09:59:54.959125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy6sN1dq8bwJPS_jK4T_eY89XY484BzJuR68dlflJc6VvZgYE_FtzceTKQW1kiHPXFi1h_ZI_jnv2y63cuWWAmCtmFfvmGj6lmJqh816MDH_lQt4Qw0fH63qKXCoQUNRNnOITiuKYSI6cXUru5wJe9L6kAmQya7lhE-_AhxPVCJKUbM Aug 31 09:59:54.959125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 09:59:54.959125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 09:59:54.959125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 09:59:54.959125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 09:59:54.959125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 09:59:54.959125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 09:59:54.959125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:59:54.959125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:54.959125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 09:59:54.959125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 09:59:54.961648 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5ed9143757584694a5139ada8dbd5570"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:59:54.961648 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:54.961648 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:59:54.961648 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:54.961648 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:59:54.961648 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 09:59:54.961648 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 09:59:54.961648 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: 25b4233e5f0e41bf99b3fb3f5f6229c9 Aug 31 09:59:54.961648 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:59:54.961648 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 09:59:54.961648 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Instance 4e42a48f-9abd-449f-8f42-f91ce8b40094 could not be found. Aug 31 09:59:54.961648 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': '4e42a48f-9abd-449f-8f42-f91ce8b40094'} Aug 31 09:59:54.963006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:59:54.963006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:54.963006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:59:54.963006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:59:54.963006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:59:54.963006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:59:54.963006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:59:54.963006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:59:54.963006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:59:54.963006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:59:54.963006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e42a48f-9abd-449f-8f42-f91ce8b40094 could not be found. Aug 31 09:59:54.963006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:59:54.963006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:59:54.963006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:59:54.963006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:54.963006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:59:54.963006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:59:54.963006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:59:54.963006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:59:54.963006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:59:54.965342 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:59:54.965342 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 09:59:54.965342 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 09:59:54.965342 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 09:59:54.965342 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 09:59:54.965342 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:59:54.965342 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:59:54.965342 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:59:54.965342 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:59:54.965342 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e42a48f-9abd-449f-8f42-f91ce8b40094 could not be found. Aug 31 09:59:54.965342 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:59:54.965342 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:59:54.965342 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:59:54.965342 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:54.965342 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:59:54.965342 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:59:54.965342 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:59:54.965342 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:59:54.965342 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e42a48f-9abd-449f-8f42-f91ce8b40094 could not be found. Aug 31 09:59:54.965342 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:59:54.967571 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-c8d38cc4-ba01-4fc9-9d01-c008579075fe tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Returning 404 to user: Instance 4e42a48f-9abd-449f-8f42-f91ce8b40094 could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:59:54.967571 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-c8d38cc4-ba01-4fc9-9d01-c008579075fe tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094" status: 404 len: 111 microversion: 2.1 time: 0.031279 Aug 31 09:59:54.967571 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 494/972] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 09:59:54 2022] DELETE /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:59:54.972004 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9d4d5fe8-da41-4126-9cf5-4d51d40feb86 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:54.972004 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-9d4d5fe8-da41-4126-9cf5-4d51d40feb86 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 4e42a48f-9abd-449f-8f42-f91ce8b40094] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:54.978182 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9d4d5fe8-da41-4126-9cf5-4d51d40feb86 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:54.978670 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9d4d5fe8-da41-4126-9cf5-4d51d40feb86 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:54.979107 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9d4d5fe8-da41-4126-9cf5-4d51d40feb86 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:54.979807 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9d4d5fe8-da41-4126-9cf5-4d51d40feb86 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:54.980258 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9d4d5fe8-da41-4126-9cf5-4d51d40feb86 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:54.980681 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9d4d5fe8-da41-4126-9cf5-4d51d40feb86 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:54.994436 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.wsgi [None req-9d4d5fe8-da41-4126-9cf5-4d51d40feb86 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] HTTP exception thrown: Instance 4e42a48f-9abd-449f-8f42-f91ce8b40094 could not be found. Aug 31 09:59:54.996126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9d4d5fe8-da41-4126-9cf5-4d51d40feb86 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Request method failure captured: Aug 31 09:59:54.996126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: request: GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094 HTTP/1.1 Aug 31 09:59:54.996126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept: application/json Aug 31 09:59:54.996126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept-Encoding: identity Aug 31 09:59:54.996126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Connection: close Aug 31 09:59:54.996126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Length: 0 Aug 31 09:59:54.996126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Type: application/json Aug 31 09:59:54.996126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Host: 10.222.0.13 Aug 31 09:59:54.996126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Openstack-System-Scope: None Aug 31 09:59:54.996126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: User-Agent: python-urllib3/1.26.12 Aug 31 09:59:54.996126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Auth-Token: gAAAAABjDy6sN1dq8bwJPS_jK4T_eY89XY484BzJuR68dlflJc6VvZgYE_FtzceTKQW1kiHPXFi1h_ZI_jnv2y63cuWWAmCtmFfvmGj6lmJqh816MDH_lQt4Qw0fH63qKXCoQUNRNnOITiuKYSI6cXUru5wJe9L6kAmQya7lhE-_AhxPVCJKUbM Aug 31 09:59:54.996126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Id: None Aug 31 09:59:54.996126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Name: None Aug 31 09:59:54.996126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Identity-Status: Confirmed Aug 31 09:59:54.996126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Is-Admin-Project: True Aug 31 09:59:54.996126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Id: default Aug 31 09:59:54.996126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Name: Default Aug 31 09:59:54.996126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:59:54.996126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:54.996126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Role: member,reader Aug 31 09:59:54.996126 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Roles: member,reader Aug 31 09:59:54.998346 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5ed9143757584694a5139ada8dbd5570"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:59:54.998346 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:54.998346 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:59:54.998346 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:54.998346 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:59:54.998346 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Id: default Aug 31 09:59:54.998346 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Name: Default Aug 31 09:59:54.998346 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Id: 25b4233e5f0e41bf99b3fb3f5f6229c9 Aug 31 09:59:54.998346 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Name: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:59:54.998346 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: method: > Aug 31 09:59:54.998346 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: exception: Instance 4e42a48f-9abd-449f-8f42-f91ce8b40094 could not be found. Aug 31 09:59:54.998346 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: action_args: {'id': '4e42a48f-9abd-449f-8f42-f91ce8b40094'} Aug 31 09:59:54.999286 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:59:54.999286 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:54.999286 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:59:54.999286 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:59:54.999286 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:59:54.999286 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:59:54.999286 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:59:54.999286 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:59:54.999286 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:59:54.999286 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:59:54.999286 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e42a48f-9abd-449f-8f42-f91ce8b40094 could not be found. Aug 31 09:59:54.999286 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:59:54.999286 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:59:54.999286 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:59:54.999286 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:54.999286 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:59:54.999286 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:59:54.999286 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:59:54.999286 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:59:54.999286 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:59:55.000746 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:59:55.000746 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:59:55.000746 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:59:55.000746 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:59:55.000746 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:59:55.000746 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:59:55.000746 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:59:55.000746 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e42a48f-9abd-449f-8f42-f91ce8b40094 could not be found. Aug 31 09:59:55.000746 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:59:55.000746 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:59:55.000746 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:59:55.000746 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:55.000746 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:59:55.000746 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:59:55.000746 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:59:55.000746 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:59:55.000746 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e42a48f-9abd-449f-8f42-f91ce8b40094 could not be found. Aug 31 09:59:55.000746 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:59:55.002119 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9d4d5fe8-da41-4126-9cf5-4d51d40feb86 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Returning 404 to user: Instance 4e42a48f-9abd-449f-8f42-f91ce8b40094 could not be found. {{(pid=127171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:59:55.002119 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-9d4d5fe8-da41-4126-9cf5-4d51d40feb86 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094" status: 404 len: 111 microversion: 2.1 time: 0.032289 Aug 31 09:59:55.002119 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 479/973] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:54 2022] GET /compute/v2.1/servers/4e42a48f-9abd-449f-8f42-f91ce8b40094 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:59:56.141080 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-7bd62103-b62c-4328-bcd4-577c81055732 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:56.141632 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-7bd62103-b62c-4328-bcd4-577c81055732 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:56.148904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7bd62103-b62c-4328-bcd4-577c81055732 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:56.149374 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7bd62103-b62c-4328-bcd4-577c81055732 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:56.149831 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7bd62103-b62c-4328-bcd4-577c81055732 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:56.150513 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7bd62103-b62c-4328-bcd4-577c81055732 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:56.150965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7bd62103-b62c-4328-bcd4-577c81055732 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:56.151381 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7bd62103-b62c-4328-bcd4-577c81055732 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:56.164882 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-7bd62103-b62c-4328-bcd4-577c81055732 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] HTTP exception thrown: Instance a3238242-6707-4564-b749-b478f64967f3 could not be found. Aug 31 09:59:56.166434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-7bd62103-b62c-4328-bcd4-577c81055732 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Request method failure captured: Aug 31 09:59:56.166434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: DELETE /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3 HTTP/1.1 Aug 31 09:59:56.166434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 09:59:56.166434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 09:59:56.166434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 09:59:56.166434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 09:59:56.166434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 09:59:56.166434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 09:59:56.166434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 09:59:56.166434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 09:59:56.166434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy6sN1dq8bwJPS_jK4T_eY89XY484BzJuR68dlflJc6VvZgYE_FtzceTKQW1kiHPXFi1h_ZI_jnv2y63cuWWAmCtmFfvmGj6lmJqh816MDH_lQt4Qw0fH63qKXCoQUNRNnOITiuKYSI6cXUru5wJe9L6kAmQya7lhE-_AhxPVCJKUbM Aug 31 09:59:56.166434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 09:59:56.166434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 09:59:56.166434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 09:59:56.166434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 09:59:56.166434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 09:59:56.166434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 09:59:56.166434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:59:56.166434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:56.166434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 09:59:56.166434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 09:59:56.168037 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5ed9143757584694a5139ada8dbd5570"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:59:56.168037 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:56.168037 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:59:56.168037 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:56.168037 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:59:56.168037 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 09:59:56.168037 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 09:59:56.168037 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: 25b4233e5f0e41bf99b3fb3f5f6229c9 Aug 31 09:59:56.168037 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:59:56.168037 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 09:59:56.168037 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Instance a3238242-6707-4564-b749-b478f64967f3 could not be found. Aug 31 09:59:56.168037 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': 'a3238242-6707-4564-b749-b478f64967f3'} Aug 31 09:59:56.168965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:59:56.168965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:56.168965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:59:56.168965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:59:56.168965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:59:56.168965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:59:56.168965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:59:56.168965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:59:56.168965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:59:56.168965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:59:56.168965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3238242-6707-4564-b749-b478f64967f3 could not be found. Aug 31 09:59:56.168965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:59:56.168965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:59:56.168965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:59:56.168965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:56.168965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:59:56.168965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:59:56.168965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:59:56.168965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:59:56.168965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:59:56.170464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:59:56.170464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 09:59:56.170464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 09:59:56.170464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 09:59:56.170464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 09:59:56.170464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:59:56.170464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:59:56.170464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:59:56.170464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:59:56.170464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3238242-6707-4564-b749-b478f64967f3 could not be found. Aug 31 09:59:56.170464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:59:56.170464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:59:56.170464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:59:56.170464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:56.170464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:59:56.170464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:59:56.170464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:59:56.170464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:59:56.170464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3238242-6707-4564-b749-b478f64967f3 could not be found. Aug 31 09:59:56.170464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:59:56.172001 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-7bd62103-b62c-4328-bcd4-577c81055732 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Returning 404 to user: Instance a3238242-6707-4564-b749-b478f64967f3 could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:59:56.172001 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-7bd62103-b62c-4328-bcd4-577c81055732 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3" status: 404 len: 111 microversion: 2.1 time: 0.031040 Aug 31 09:59:56.172001 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 495/974] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 09:59:56 2022] DELETE /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:59:56.176672 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-0ea573a8-09cf-4a16-ae24-b729fe6fcd03 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:56.177290 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-0ea573a8-09cf-4a16-ae24-b729fe6fcd03 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: a3238242-6707-4564-b749-b478f64967f3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:56.183659 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0ea573a8-09cf-4a16-ae24-b729fe6fcd03 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:56.184138 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0ea573a8-09cf-4a16-ae24-b729fe6fcd03 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:56.184570 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0ea573a8-09cf-4a16-ae24-b729fe6fcd03 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:56.185254 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0ea573a8-09cf-4a16-ae24-b729fe6fcd03 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:56.185737 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0ea573a8-09cf-4a16-ae24-b729fe6fcd03 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:56.186158 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0ea573a8-09cf-4a16-ae24-b729fe6fcd03 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:56.200193 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.wsgi [None req-0ea573a8-09cf-4a16-ae24-b729fe6fcd03 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] HTTP exception thrown: Instance a3238242-6707-4564-b749-b478f64967f3 could not be found. Aug 31 09:59:56.201739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-0ea573a8-09cf-4a16-ae24-b729fe6fcd03 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Request method failure captured: Aug 31 09:59:56.201739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: request: GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3 HTTP/1.1 Aug 31 09:59:56.201739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept: application/json Aug 31 09:59:56.201739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept-Encoding: identity Aug 31 09:59:56.201739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Connection: close Aug 31 09:59:56.201739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Length: 0 Aug 31 09:59:56.201739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Type: application/json Aug 31 09:59:56.201739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Host: 10.222.0.13 Aug 31 09:59:56.201739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Openstack-System-Scope: None Aug 31 09:59:56.201739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: User-Agent: python-urllib3/1.26.12 Aug 31 09:59:56.201739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Auth-Token: gAAAAABjDy6sN1dq8bwJPS_jK4T_eY89XY484BzJuR68dlflJc6VvZgYE_FtzceTKQW1kiHPXFi1h_ZI_jnv2y63cuWWAmCtmFfvmGj6lmJqh816MDH_lQt4Qw0fH63qKXCoQUNRNnOITiuKYSI6cXUru5wJe9L6kAmQya7lhE-_AhxPVCJKUbM Aug 31 09:59:56.201739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Id: None Aug 31 09:59:56.201739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Name: None Aug 31 09:59:56.201739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Identity-Status: Confirmed Aug 31 09:59:56.201739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Is-Admin-Project: True Aug 31 09:59:56.201739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Id: default Aug 31 09:59:56.201739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Name: Default Aug 31 09:59:56.201739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:59:56.201739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:56.201739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Role: member,reader Aug 31 09:59:56.201739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Roles: member,reader Aug 31 09:59:56.203296 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5ed9143757584694a5139ada8dbd5570"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:59:56.203296 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:56.203296 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:59:56.203296 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:56.203296 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:59:56.203296 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Id: default Aug 31 09:59:56.203296 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Name: Default Aug 31 09:59:56.203296 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Id: 25b4233e5f0e41bf99b3fb3f5f6229c9 Aug 31 09:59:56.203296 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Name: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:59:56.203296 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: method: > Aug 31 09:59:56.203296 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: exception: Instance a3238242-6707-4564-b749-b478f64967f3 could not be found. Aug 31 09:59:56.203296 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: action_args: {'id': 'a3238242-6707-4564-b749-b478f64967f3'} Aug 31 09:59:56.204309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:59:56.204309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:56.204309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:59:56.204309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:59:56.204309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:59:56.204309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:59:56.204309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:59:56.204309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:59:56.204309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:59:56.204309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:59:56.204309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3238242-6707-4564-b749-b478f64967f3 could not be found. Aug 31 09:59:56.204309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:59:56.204309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:59:56.204309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:59:56.204309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:56.204309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:59:56.204309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:59:56.204309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:59:56.204309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:59:56.204309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:59:56.205834 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:59:56.205834 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:59:56.205834 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:59:56.205834 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:59:56.205834 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:59:56.205834 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:59:56.205834 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:59:56.205834 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3238242-6707-4564-b749-b478f64967f3 could not be found. Aug 31 09:59:56.205834 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:59:56.205834 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:59:56.205834 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:59:56.205834 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:56.205834 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:59:56.205834 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:59:56.205834 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:59:56.205834 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:59:56.205834 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3238242-6707-4564-b749-b478f64967f3 could not be found. Aug 31 09:59:56.205834 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:59:56.207949 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-0ea573a8-09cf-4a16-ae24-b729fe6fcd03 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Returning 404 to user: Instance a3238242-6707-4564-b749-b478f64967f3 could not be found. {{(pid=127171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:59:56.207949 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-0ea573a8-09cf-4a16-ae24-b729fe6fcd03 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3" status: 404 len: 111 microversion: 2.1 time: 0.030657 Aug 31 09:59:56.207949 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 480/975] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:56 2022] GET /compute/v2.1/servers/a3238242-6707-4564-b749-b478f64967f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:59:56.212355 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-439ddab2-bffe-429d-a79a-8051e443c4e0 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:56.212846 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-439ddab2-bffe-429d-a79a-8051e443c4e0 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:56.218981 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-439ddab2-bffe-429d-a79a-8051e443c4e0 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:56.219457 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-439ddab2-bffe-429d-a79a-8051e443c4e0 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:56.219885 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-439ddab2-bffe-429d-a79a-8051e443c4e0 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:56.220563 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-439ddab2-bffe-429d-a79a-8051e443c4e0 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:56.221032 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-439ddab2-bffe-429d-a79a-8051e443c4e0 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:56.221468 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-439ddab2-bffe-429d-a79a-8051e443c4e0 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:56.235125 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-439ddab2-bffe-429d-a79a-8051e443c4e0 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] HTTP exception thrown: Instance 2f64ad4a-cdde-4c1e-ac02-3977cdadef31 could not be found. Aug 31 09:59:56.236633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-439ddab2-bffe-429d-a79a-8051e443c4e0 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Request method failure captured: Aug 31 09:59:56.236633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: DELETE /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 HTTP/1.1 Aug 31 09:59:56.236633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 09:59:56.236633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 09:59:56.236633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 09:59:56.236633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 09:59:56.236633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 09:59:56.236633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 09:59:56.236633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 09:59:56.236633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 09:59:56.236633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy6sN1dq8bwJPS_jK4T_eY89XY484BzJuR68dlflJc6VvZgYE_FtzceTKQW1kiHPXFi1h_ZI_jnv2y63cuWWAmCtmFfvmGj6lmJqh816MDH_lQt4Qw0fH63qKXCoQUNRNnOITiuKYSI6cXUru5wJe9L6kAmQya7lhE-_AhxPVCJKUbM Aug 31 09:59:56.236633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 09:59:56.236633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 09:59:56.236633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 09:59:56.236633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 09:59:56.236633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 09:59:56.236633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 09:59:56.236633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:59:56.236633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:56.236633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 09:59:56.236633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 09:59:56.238281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5ed9143757584694a5139ada8dbd5570"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:59:56.238281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:56.238281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:59:56.238281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:56.238281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:59:56.238281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 09:59:56.238281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 09:59:56.238281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: 25b4233e5f0e41bf99b3fb3f5f6229c9 Aug 31 09:59:56.238281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:59:56.238281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 09:59:56.238281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Instance 2f64ad4a-cdde-4c1e-ac02-3977cdadef31 could not be found. Aug 31 09:59:56.238281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': '2f64ad4a-cdde-4c1e-ac02-3977cdadef31'} Aug 31 09:59:56.239526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:59:56.239526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:56.239526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:59:56.239526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:59:56.239526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:59:56.239526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:59:56.239526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:59:56.239526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:59:56.239526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:59:56.239526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:59:56.239526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f64ad4a-cdde-4c1e-ac02-3977cdadef31 could not be found. Aug 31 09:59:56.239526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:59:56.239526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:59:56.239526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:59:56.239526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:56.239526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:59:56.239526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:59:56.239526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:59:56.239526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:59:56.239526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:59:56.241155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:59:56.241155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 09:59:56.241155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 09:59:56.241155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 09:59:56.241155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 09:59:56.241155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:59:56.241155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:59:56.241155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:59:56.241155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:59:56.241155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f64ad4a-cdde-4c1e-ac02-3977cdadef31 could not be found. Aug 31 09:59:56.241155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:59:56.241155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:59:56.241155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:59:56.241155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:56.241155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:59:56.241155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:59:56.241155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:59:56.241155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:59:56.241155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f64ad4a-cdde-4c1e-ac02-3977cdadef31 could not be found. Aug 31 09:59:56.241155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:59:56.242902 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-439ddab2-bffe-429d-a79a-8051e443c4e0 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Returning 404 to user: Instance 2f64ad4a-cdde-4c1e-ac02-3977cdadef31 could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:59:56.242902 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-439ddab2-bffe-429d-a79a-8051e443c4e0 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 404 len: 111 microversion: 2.1 time: 0.029587 Aug 31 09:59:56.242902 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 496/976] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 09:59:56 2022] DELETE /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:59:56.246687 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-6a292c49-2125-449b-ad5f-c84678e0f993 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:56.247291 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-6a292c49-2125-449b-ad5f-c84678e0f993 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: 2f64ad4a-cdde-4c1e-ac02-3977cdadef31] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:56.254211 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6a292c49-2125-449b-ad5f-c84678e0f993 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:56.254680 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6a292c49-2125-449b-ad5f-c84678e0f993 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:56.255106 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6a292c49-2125-449b-ad5f-c84678e0f993 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:56.255783 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6a292c49-2125-449b-ad5f-c84678e0f993 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:56.256227 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6a292c49-2125-449b-ad5f-c84678e0f993 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:56.256640 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-6a292c49-2125-449b-ad5f-c84678e0f993 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:56.271806 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.wsgi [None req-6a292c49-2125-449b-ad5f-c84678e0f993 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] HTTP exception thrown: Instance 2f64ad4a-cdde-4c1e-ac02-3977cdadef31 could not be found. Aug 31 09:59:56.273310 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-6a292c49-2125-449b-ad5f-c84678e0f993 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Request method failure captured: Aug 31 09:59:56.273310 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: request: GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 HTTP/1.1 Aug 31 09:59:56.273310 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept: application/json Aug 31 09:59:56.273310 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept-Encoding: identity Aug 31 09:59:56.273310 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Connection: close Aug 31 09:59:56.273310 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Length: 0 Aug 31 09:59:56.273310 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Type: application/json Aug 31 09:59:56.273310 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Host: 10.222.0.13 Aug 31 09:59:56.273310 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Openstack-System-Scope: None Aug 31 09:59:56.273310 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: User-Agent: python-urllib3/1.26.12 Aug 31 09:59:56.273310 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Auth-Token: gAAAAABjDy6sN1dq8bwJPS_jK4T_eY89XY484BzJuR68dlflJc6VvZgYE_FtzceTKQW1kiHPXFi1h_ZI_jnv2y63cuWWAmCtmFfvmGj6lmJqh816MDH_lQt4Qw0fH63qKXCoQUNRNnOITiuKYSI6cXUru5wJe9L6kAmQya7lhE-_AhxPVCJKUbM Aug 31 09:59:56.273310 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Id: None Aug 31 09:59:56.273310 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Name: None Aug 31 09:59:56.273310 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Identity-Status: Confirmed Aug 31 09:59:56.273310 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Is-Admin-Project: True Aug 31 09:59:56.273310 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Id: default Aug 31 09:59:56.273310 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Name: Default Aug 31 09:59:56.273310 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:59:56.273310 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:56.273310 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Role: member,reader Aug 31 09:59:56.273310 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Roles: member,reader Aug 31 09:59:56.274917 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5ed9143757584694a5139ada8dbd5570"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:59:56.274917 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:56.274917 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:59:56.274917 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:56.274917 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:59:56.274917 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Id: default Aug 31 09:59:56.274917 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Name: Default Aug 31 09:59:56.274917 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Id: 25b4233e5f0e41bf99b3fb3f5f6229c9 Aug 31 09:59:56.274917 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Name: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:59:56.274917 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: method: > Aug 31 09:59:56.274917 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: exception: Instance 2f64ad4a-cdde-4c1e-ac02-3977cdadef31 could not be found. Aug 31 09:59:56.274917 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: action_args: {'id': '2f64ad4a-cdde-4c1e-ac02-3977cdadef31'} Aug 31 09:59:56.276005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:59:56.276005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:56.276005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:59:56.276005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:59:56.276005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:59:56.276005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:59:56.276005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:59:56.276005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:59:56.276005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:59:56.276005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:59:56.276005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f64ad4a-cdde-4c1e-ac02-3977cdadef31 could not be found. Aug 31 09:59:56.276005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:59:56.276005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:59:56.276005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:59:56.276005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:56.276005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:59:56.276005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:59:56.276005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:59:56.276005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:59:56.276005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:59:56.277515 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:59:56.277515 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:59:56.277515 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:59:56.277515 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:59:56.277515 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:59:56.277515 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:59:56.277515 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:59:56.277515 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f64ad4a-cdde-4c1e-ac02-3977cdadef31 could not be found. Aug 31 09:59:56.277515 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:59:56.277515 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:59:56.277515 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:59:56.277515 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:56.277515 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:59:56.277515 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:59:56.277515 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:59:56.277515 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:59:56.277515 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f64ad4a-cdde-4c1e-ac02-3977cdadef31 could not be found. Aug 31 09:59:56.277515 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:59:56.278945 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-6a292c49-2125-449b-ad5f-c84678e0f993 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Returning 404 to user: Instance 2f64ad4a-cdde-4c1e-ac02-3977cdadef31 could not be found. {{(pid=127171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:59:56.278945 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-6a292c49-2125-449b-ad5f-c84678e0f993 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31" status: 404 len: 111 microversion: 2.1 time: 0.031817 Aug 31 09:59:56.278945 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 481/977] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:56 2022] GET /compute/v2.1/servers/2f64ad4a-cdde-4c1e-ac02-3977cdadef31 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:59:57.420639 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f0115bbb-af22-4c89-a2e1-436e2349519c tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:57.421810 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-f0115bbb-af22-4c89-a2e1-436e2349519c tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:57.428318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f0115bbb-af22-4c89-a2e1-436e2349519c tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:57.428792 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f0115bbb-af22-4c89-a2e1-436e2349519c tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:57.429215 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f0115bbb-af22-4c89-a2e1-436e2349519c tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:57.429931 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f0115bbb-af22-4c89-a2e1-436e2349519c tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:57.430374 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f0115bbb-af22-4c89-a2e1-436e2349519c tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:57.430788 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f0115bbb-af22-4c89-a2e1-436e2349519c tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:57.446469 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-f0115bbb-af22-4c89-a2e1-436e2349519c tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] HTTP exception thrown: Instance cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 could not be found. Aug 31 09:59:57.448000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f0115bbb-af22-4c89-a2e1-436e2349519c tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Request method failure captured: Aug 31 09:59:57.448000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: DELETE /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 HTTP/1.1 Aug 31 09:59:57.448000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 09:59:57.448000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 09:59:57.448000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 09:59:57.448000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 09:59:57.448000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 09:59:57.448000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 09:59:57.448000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 09:59:57.448000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 09:59:57.448000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy6sN1dq8bwJPS_jK4T_eY89XY484BzJuR68dlflJc6VvZgYE_FtzceTKQW1kiHPXFi1h_ZI_jnv2y63cuWWAmCtmFfvmGj6lmJqh816MDH_lQt4Qw0fH63qKXCoQUNRNnOITiuKYSI6cXUru5wJe9L6kAmQya7lhE-_AhxPVCJKUbM Aug 31 09:59:57.448000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 09:59:57.448000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 09:59:57.448000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 09:59:57.448000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 09:59:57.448000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 09:59:57.448000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 09:59:57.448000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:59:57.448000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:57.448000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 09:59:57.448000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 09:59:57.449652 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5ed9143757584694a5139ada8dbd5570"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:59:57.449652 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:57.449652 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:59:57.449652 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:57.449652 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:59:57.449652 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 09:59:57.449652 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 09:59:57.449652 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: 25b4233e5f0e41bf99b3fb3f5f6229c9 Aug 31 09:59:57.449652 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:59:57.449652 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 09:59:57.449652 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Instance cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 could not be found. Aug 31 09:59:57.449652 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': 'cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3'} Aug 31 09:59:57.450472 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:59:57.450472 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:57.450472 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:59:57.450472 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:59:57.450472 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:59:57.450472 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:59:57.450472 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:59:57.450472 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:59:57.450472 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:59:57.450472 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:59:57.450472 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 could not be found. Aug 31 09:59:57.450472 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:59:57.450472 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:59:57.450472 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:59:57.450472 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:57.450472 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:59:57.450472 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:59:57.450472 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:59:57.450472 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:59:57.450472 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:59:57.451666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:59:57.451666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 09:59:57.451666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 09:59:57.451666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 09:59:57.451666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 09:59:57.451666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:59:57.451666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:59:57.451666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:59:57.451666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:59:57.451666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 could not be found. Aug 31 09:59:57.451666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:59:57.451666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:59:57.451666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:59:57.451666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:57.451666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:59:57.451666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:59:57.451666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:59:57.451666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:59:57.451666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 could not be found. Aug 31 09:59:57.451666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 09:59:57.452900 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f0115bbb-af22-4c89-a2e1-436e2349519c tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Returning 404 to user: Instance cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:59:57.452900 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-f0115bbb-af22-4c89-a2e1-436e2349519c tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 404 len: 111 microversion: 2.1 time: 0.032644 Aug 31 09:59:57.452900 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 497/978] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 09:59:57 2022] DELETE /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:59:57.457977 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-96a88f41-c05b-46ce-b4ec-f87f2dc183e8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:57.458721 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-96a88f41-c05b-46ce-b4ec-f87f2dc183e8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] [instance: cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:57.465017 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-96a88f41-c05b-46ce-b4ec-f87f2dc183e8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:57.465522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-96a88f41-c05b-46ce-b4ec-f87f2dc183e8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:57.466108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-96a88f41-c05b-46ce-b4ec-f87f2dc183e8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:57.466649 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-96a88f41-c05b-46ce-b4ec-f87f2dc183e8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:57.467094 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-96a88f41-c05b-46ce-b4ec-f87f2dc183e8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:57.467594 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-96a88f41-c05b-46ce-b4ec-f87f2dc183e8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:57.483031 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.wsgi [None req-96a88f41-c05b-46ce-b4ec-f87f2dc183e8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] HTTP exception thrown: Instance cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 could not be found. Aug 31 09:59:57.484567 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-96a88f41-c05b-46ce-b4ec-f87f2dc183e8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Request method failure captured: Aug 31 09:59:57.484567 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: request: GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 HTTP/1.1 Aug 31 09:59:57.484567 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept: application/json Aug 31 09:59:57.484567 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept-Encoding: identity Aug 31 09:59:57.484567 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Connection: close Aug 31 09:59:57.484567 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Length: 0 Aug 31 09:59:57.484567 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Type: application/json Aug 31 09:59:57.484567 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Host: 10.222.0.13 Aug 31 09:59:57.484567 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Openstack-System-Scope: None Aug 31 09:59:57.484567 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: User-Agent: python-urllib3/1.26.12 Aug 31 09:59:57.484567 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Auth-Token: gAAAAABjDy6sN1dq8bwJPS_jK4T_eY89XY484BzJuR68dlflJc6VvZgYE_FtzceTKQW1kiHPXFi1h_ZI_jnv2y63cuWWAmCtmFfvmGj6lmJqh816MDH_lQt4Qw0fH63qKXCoQUNRNnOITiuKYSI6cXUru5wJe9L6kAmQya7lhE-_AhxPVCJKUbM Aug 31 09:59:57.484567 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Id: None Aug 31 09:59:57.484567 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Name: None Aug 31 09:59:57.484567 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Identity-Status: Confirmed Aug 31 09:59:57.484567 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Is-Admin-Project: True Aug 31 09:59:57.484567 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Id: default Aug 31 09:59:57.484567 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Name: Default Aug 31 09:59:57.484567 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:59:57.484567 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:57.484567 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Role: member,reader Aug 31 09:59:57.484567 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Roles: member,reader Aug 31 09:59:57.486294 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5ed9143757584694a5139ada8dbd5570"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5ed9143757584694a5139ada8dbd5570"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 09:59:57.486294 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:57.486294 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Id: 5ed9143757584694a5139ada8dbd5570 Aug 31 09:59:57.486294 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-729389795 Aug 31 09:59:57.486294 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:59:57.486294 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Id: default Aug 31 09:59:57.486294 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Name: Default Aug 31 09:59:57.486294 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Id: 25b4233e5f0e41bf99b3fb3f5f6229c9 Aug 31 09:59:57.486294 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Name: tempest-AttachVolumeNegativeTest-729389795-project Aug 31 09:59:57.486294 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: method: > Aug 31 09:59:57.486294 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: exception: Instance cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 could not be found. Aug 31 09:59:57.486294 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: action_args: {'id': 'cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3'} Aug 31 09:59:57.487159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:59:57.487159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:57.487159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:59:57.487159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:59:57.487159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:59:57.487159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:59:57.487159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:59:57.487159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:59:57.487159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:59:57.487159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:59:57.487159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 could not be found. Aug 31 09:59:57.487159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:59:57.487159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:59:57.487159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:59:57.487159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:57.487159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:59:57.487159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:59:57.487159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:59:57.487159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:59:57.487159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:59:57.489828 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:59:57.489828 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:59:57.489828 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:59:57.489828 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:59:57.489828 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:59:57.489828 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:59:57.489828 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:59:57.489828 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 could not be found. Aug 31 09:59:57.489828 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:59:57.489828 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:59:57.489828 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:59:57.489828 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:57.489828 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:59:57.489828 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:59:57.489828 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:59:57.489828 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:59:57.489828 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 could not be found. Aug 31 09:59:57.489828 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 09:59:57.491093 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-96a88f41-c05b-46ce-b4ec-f87f2dc183e8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] Returning 404 to user: Instance cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 could not be found. {{(pid=127171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:59:57.491093 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-96a88f41-c05b-46ce-b4ec-f87f2dc183e8 tempest-AttachVolumeNegativeTest-729389795 tempest-AttachVolumeNegativeTest-729389795-project] 10.222.0.13 "GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3" status: 404 len: 111 microversion: 2.1 time: 0.031878 Aug 31 09:59:57.491093 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 482/979] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:57 2022] GET /compute/v2.1/servers/cd8788bf-ffd0-4c96-ab5f-cc3e64f9c3b3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 10:00:28.590065 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-55f6ee73-8f33-4c2f-bc7d-e861791a14fc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-768515134", "imageRef": "8e078bb9-f274-4984-8128-d31407d49604", "flavorRef": "452"}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:00:28.597181 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=11 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:28.597884 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=7 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:28.649076 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.network.neutron [None req-55f6ee73-8f33-4c2f-bc7d-e861791a14fc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] validate_networks() for None {{(pid=127170) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 10:00:28.935610 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-55f6ee73-8f33-4c2f-bc7d-e861791a14fc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Flavor limits 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 10:00:28.936050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-55f6ee73-8f33-4c2f-bc7d-e861791a14fc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Image limits 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 10:00:28.936516 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-55f6ee73-8f33-4c2f-bc7d-e861791a14fc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Flavor pref 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 10:00:28.936914 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-55f6ee73-8f33-4c2f-bc7d-e861791a14fc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Image pref 0:0:0 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 10:00:28.937322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.virt.hardware [None req-55f6ee73-8f33-4c2f-bc7d-e861791a14fc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 10:00:28.946443 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-55f6ee73-8f33-4c2f-bc7d-e861791a14fc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:28.946916 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-55f6ee73-8f33-4c2f-bc7d-e861791a14fc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:28.947340 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-55f6ee73-8f33-4c2f-bc7d-e861791a14fc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:28.948054 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-55f6ee73-8f33-4c2f-bc7d-e861791a14fc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:28.948503 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-55f6ee73-8f33-4c2f-bc7d-e861791a14fc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:28.948915 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-55f6ee73-8f33-4c2f-bc7d-e861791a14fc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:28.968666 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-55f6ee73-8f33-4c2f-bc7d-e861791a14fc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Getting quotas for project cdafb29648f34d9cbad378da051ac5c5. Resources: {'ram', 'instances', 'cores'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:00:28.972864 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-55f6ee73-8f33-4c2f-bc7d-e861791a14fc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Getting quotas for user e98df7d1938343f081cd4e003fbf43a3 and project cdafb29648f34d9cbad378da051ac5c5. Resources: {'ram', 'instances', 'cores'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:00:28.985218 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-55f6ee73-8f33-4c2f-bc7d-e861791a14fc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Going to run 1 instances... {{(pid=127170) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 10:00:28.987546 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-55f6ee73-8f33-4c2f-bc7d-e861791a14fc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] [instance: ba84763c-52ec-4d7e-b9e5-2a945c63f426] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8e078bb9-f274-4984-8128-d31407d49604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 10:00:29.003456 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-85e26a45-e8a1-4507-ad02-74500fcac957 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:29.004121 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-85e26a45-e8a1-4507-ad02-74500fcac957 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:29.006489 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:29.007540 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=44,nova_cell1:INSERT=1 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:29.017828 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-85e26a45-e8a1-4507-ad02-74500fcac957 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:29.018531 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-85e26a45-e8a1-4507-ad02-74500fcac957 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:29.019232 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-85e26a45-e8a1-4507-ad02-74500fcac957 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:29.020080 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-85e26a45-e8a1-4507-ad02-74500fcac957 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:29.020629 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-85e26a45-e8a1-4507-ad02-74500fcac957 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:29.021054 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-85e26a45-e8a1-4507-ad02-74500fcac957 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:29.043113 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-55f6ee73-8f33-4c2f-bc7d-e861791a14fc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.457037 Aug 31 10:00:29.044297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 498/980] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 31 10:00:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 10:00:29.055793 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-ff10ed7e-9a34-4168-a01c-f7c376690d09 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:29.056416 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-ff10ed7e-9a34-4168-a01c-f7c376690d09 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] [instance: ba84763c-52ec-4d7e-b9e5-2a945c63f426] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:29.057081 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-85e26a45-e8a1-4507-ad02-74500fcac957 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9/os-volume_attachments/cdfa4ddc-296f-4722-8e5a-596a603705b0" status: 200 len: 194 microversion: 2.20 time: 0.057868 Aug 31 10:00:29.058147 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 483/981] 10.222.0.13 () {60 vars in 1454 bytes} [Wed Aug 31 10:00:28 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9/os-volume_attachments/cdfa4ddc-296f-4722-8e5a-596a603705b0 => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:00:29.133727 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-ff10ed7e-9a34-4168-a01c-f7c376690d09 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98df7d1938343f081cd4e003fbf43a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdafb29648f34d9cbad378da051ac5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:29.138294 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-4054f33f-ea9d-41ce-a1e2-620400f3807d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:29.138985 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-4054f33f-ea9d-41ce-a1e2-620400f3807d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:29.142207 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-ff10ed7e-9a34-4168-a01c-f7c376690d09 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] 10.222.0.13 "GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426" status: 200 len: 1214 microversion: 2.1 time: 0.090679 Aug 31 10:00:29.142948 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 499/982] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:29 2022] GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:29.148505 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4054f33f-ea9d-41ce-a1e2-620400f3807d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:29.148505 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4054f33f-ea9d-41ce-a1e2-620400f3807d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:29.148505 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4054f33f-ea9d-41ce-a1e2-620400f3807d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:29.148505 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4054f33f-ea9d-41ce-a1e2-620400f3807d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:29.149032 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4054f33f-ea9d-41ce-a1e2-620400f3807d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:29.149032 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4054f33f-ea9d-41ce-a1e2-620400f3807d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:29.235570 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.objects.instance [None req-4054f33f-ea9d-41ce-a1e2-620400f3807d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lazy-loading 'services' on Instance uuid b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 {{(pid=127171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:00:29.310651 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-4054f33f-ea9d-41ce-a1e2-620400f3807d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9/os-volume_attachments/cdfa4ddc-296f-4722-8e5a-596a603705b0" status: 202 len: 0 microversion: 2.20 time: 0.176061 Aug 31 10:00:29.311219 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 484/983] 10.222.0.13 () {60 vars in 1457 bytes} [Wed Aug 31 10:00:29 2022] DELETE /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9/os-volume_attachments/cdfa4ddc-296f-4722-8e5a-596a603705b0 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 10:00:29.320243 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-1cf25c04-b646-4c11-b55b-7a1681188b60 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:29.322714 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-1cf25c04-b646-4c11-b55b-7a1681188b60 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:29.487992 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1cf25c04-b646-4c11-b55b-7a1681188b60 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:29.488496 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1cf25c04-b646-4c11-b55b-7a1681188b60 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:29.489201 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1cf25c04-b646-4c11-b55b-7a1681188b60 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:29.489933 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1cf25c04-b646-4c11-b55b-7a1681188b60 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:29.490396 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1cf25c04-b646-4c11-b55b-7a1681188b60 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:29.490820 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1cf25c04-b646-4c11-b55b-7a1681188b60 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:29.522868 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-1cf25c04-b646-4c11-b55b-7a1681188b60 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.206565 Aug 31 10:00:29.523472 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 500/984] 10.222.0.13 () {60 vars in 1343 bytes} [Wed Aug 31 10:00:29 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:00:30.167205 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-b1047e1d-f768-4a07-ae40-df87b675d2f9 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:30.167920 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-b1047e1d-f768-4a07-ae40-df87b675d2f9 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] [instance: ba84763c-52ec-4d7e-b9e5-2a945c63f426] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:30.174750 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b1047e1d-f768-4a07-ae40-df87b675d2f9 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:30.175242 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b1047e1d-f768-4a07-ae40-df87b675d2f9 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:30.175679 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b1047e1d-f768-4a07-ae40-df87b675d2f9 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:30.176491 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b1047e1d-f768-4a07-ae40-df87b675d2f9 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:30.176954 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b1047e1d-f768-4a07-ae40-df87b675d2f9 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:30.177422 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b1047e1d-f768-4a07-ae40-df87b675d2f9 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:30.255506 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b1047e1d-f768-4a07-ae40-df87b675d2f9 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98df7d1938343f081cd4e003fbf43a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdafb29648f34d9cbad378da051ac5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:30.263838 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-b1047e1d-f768-4a07-ae40-df87b675d2f9 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] 10.222.0.13 "GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426" status: 200 len: 1266 microversion: 2.1 time: 0.103387 Aug 31 10:00:30.264436 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 485/985] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:30 2022] GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426 => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:30.535474 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-e7698628-a7fd-4602-a4a6-410804fad79c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:30.537477 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-e7698628-a7fd-4602-a4a6-410804fad79c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:30.544780 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e7698628-a7fd-4602-a4a6-410804fad79c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:30.545256 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e7698628-a7fd-4602-a4a6-410804fad79c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:30.545716 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e7698628-a7fd-4602-a4a6-410804fad79c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:30.546404 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e7698628-a7fd-4602-a4a6-410804fad79c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:30.546843 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e7698628-a7fd-4602-a4a6-410804fad79c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:30.547254 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-e7698628-a7fd-4602-a4a6-410804fad79c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:30.579090 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-e7698628-a7fd-4602-a4a6-410804fad79c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047630 Aug 31 10:00:30.579913 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 501/986] 10.222.0.13 () {60 vars in 1343 bytes} [Wed Aug 31 10:00:30 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:00:31.285633 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-54456ebf-a444-4626-8f7b-ad0542309c71 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:31.286287 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-54456ebf-a444-4626-8f7b-ad0542309c71 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] [instance: ba84763c-52ec-4d7e-b9e5-2a945c63f426] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:31.293566 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-54456ebf-a444-4626-8f7b-ad0542309c71 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:31.293986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-54456ebf-a444-4626-8f7b-ad0542309c71 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:31.294450 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-54456ebf-a444-4626-8f7b-ad0542309c71 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:31.295130 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-54456ebf-a444-4626-8f7b-ad0542309c71 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:31.295965 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-54456ebf-a444-4626-8f7b-ad0542309c71 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:31.295965 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-54456ebf-a444-4626-8f7b-ad0542309c71 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:31.388088 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-54456ebf-a444-4626-8f7b-ad0542309c71 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98df7d1938343f081cd4e003fbf43a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdafb29648f34d9cbad378da051ac5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:31.396148 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-54456ebf-a444-4626-8f7b-ad0542309c71 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] 10.222.0.13 "GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426" status: 200 len: 1272 microversion: 2.1 time: 0.114435 Aug 31 10:00:31.396733 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 486/987] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:31 2022] GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426 => generated 1272 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:31.592810 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-902d226f-0e92-48f5-9a26-04dd7da88161 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:31.595279 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-902d226f-0e92-48f5-9a26-04dd7da88161 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:31.603536 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-902d226f-0e92-48f5-9a26-04dd7da88161 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:31.604489 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-902d226f-0e92-48f5-9a26-04dd7da88161 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:31.605067 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-902d226f-0e92-48f5-9a26-04dd7da88161 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:31.605921 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-902d226f-0e92-48f5-9a26-04dd7da88161 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:31.606451 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-902d226f-0e92-48f5-9a26-04dd7da88161 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:31.607122 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-902d226f-0e92-48f5-9a26-04dd7da88161 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:31.640208 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-902d226f-0e92-48f5-9a26-04dd7da88161 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051974 Aug 31 10:00:31.640786 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 502/988] 10.222.0.13 () {60 vars in 1343 bytes} [Wed Aug 31 10:00:31 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:31.706869 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-895d1e48-75c6-406b-9315-220229f5f122 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:31.707641 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-895d1e48-75c6-406b-9315-220229f5f122 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:31.714953 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-895d1e48-75c6-406b-9315-220229f5f122 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:31.715655 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-895d1e48-75c6-406b-9315-220229f5f122 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:31.716263 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-895d1e48-75c6-406b-9315-220229f5f122 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:31.716963 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-895d1e48-75c6-406b-9315-220229f5f122 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:31.717462 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-895d1e48-75c6-406b-9315-220229f5f122 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:31.717858 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-895d1e48-75c6-406b-9315-220229f5f122 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:31.748467 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-895d1e48-75c6-406b-9315-220229f5f122 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Going to try to terminate instance {{(pid=127171) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 10:00:31.836494 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-895d1e48-75c6-406b-9315-220229f5f122 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 204 len: 0 microversion: 2.20 time: 0.133480 Aug 31 10:00:31.837090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 487/989] 10.222.0.13 () {60 vars in 1280 bytes} [Wed Aug 31 10:00:31 2022] DELETE /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 10:00:31.846624 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-bcbd167d-f3a3-47cb-b286-0dcca9aea5e9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:31.847235 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-bcbd167d-f3a3-47cb-b286-0dcca9aea5e9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:31.853600 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bcbd167d-f3a3-47cb-b286-0dcca9aea5e9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:31.854086 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bcbd167d-f3a3-47cb-b286-0dcca9aea5e9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:31.854511 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bcbd167d-f3a3-47cb-b286-0dcca9aea5e9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:31.855410 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bcbd167d-f3a3-47cb-b286-0dcca9aea5e9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:31.855856 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bcbd167d-f3a3-47cb-b286-0dcca9aea5e9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:31.856275 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-bcbd167d-f3a3-47cb-b286-0dcca9aea5e9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:32.066032 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-bcbd167d-f3a3-47cb-b286-0dcca9aea5e9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:32.074402 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-bcbd167d-f3a3-47cb-b286-0dcca9aea5e9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:32.075841 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-bcbd167d-f3a3-47cb-b286-0dcca9aea5e9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:32.077026 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-bcbd167d-f3a3-47cb-b286-0dcca9aea5e9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1725 microversion: 2.20 time: 0.234324 Aug 31 10:00:32.077653 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 503/990] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:00:31 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1725 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 10:00:32.316621 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-22d2feae-5c49-4c05-9fe4-f8a8d2c787ce req-fe678342-8fc8-4501-8fab-81d7667c6831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba84763c-52ec-4d7e-b9e5-2a945c63f426", "tag": "2ab97470-728c-4977-b280-3db1e3c28e5c"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:00:32.327407 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-22d2feae-5c49-4c05-9fe4-f8a8d2c787ce req-fe678342-8fc8-4501-8fab-81d7667c6831 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:32.327883 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-22d2feae-5c49-4c05-9fe4-f8a8d2c787ce req-fe678342-8fc8-4501-8fab-81d7667c6831 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:32.328309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-22d2feae-5c49-4c05-9fe4-f8a8d2c787ce req-fe678342-8fc8-4501-8fab-81d7667c6831 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:32.340254 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-22d2feae-5c49-4c05-9fe4-f8a8d2c787ce req-fe678342-8fc8-4501-8fab-81d7667c6831 service nova] Creating event network-changed:2ab97470-728c-4977-b280-3db1e3c28e5c for instance ba84763c-52ec-4d7e-b9e5-2a945c63f426 on hv-cinder-84496 Aug 31 10:00:32.345005 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-22d2feae-5c49-4c05-9fe4-f8a8d2c787ce req-fe678342-8fc8-4501-8fab-81d7667c6831 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032514 Aug 31 10:00:32.345642 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 488/991] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 10:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:00:32.417725 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-74df4850-d662-4fcd-962b-fab30e8eb570 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:32.418326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-74df4850-d662-4fcd-962b-fab30e8eb570 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] [instance: ba84763c-52ec-4d7e-b9e5-2a945c63f426] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:32.424247 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-74df4850-d662-4fcd-962b-fab30e8eb570 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:32.424725 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-74df4850-d662-4fcd-962b-fab30e8eb570 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:32.425150 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-74df4850-d662-4fcd-962b-fab30e8eb570 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:32.425862 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-74df4850-d662-4fcd-962b-fab30e8eb570 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:32.426312 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-74df4850-d662-4fcd-962b-fab30e8eb570 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:32.426719 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-74df4850-d662-4fcd-962b-fab30e8eb570 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:32.561579 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-74df4850-d662-4fcd-962b-fab30e8eb570 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98df7d1938343f081cd4e003fbf43a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdafb29648f34d9cbad378da051ac5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:32.570752 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-74df4850-d662-4fcd-962b-fab30e8eb570 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] 10.222.0.13 "GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426" status: 200 len: 1314 microversion: 2.1 time: 0.155451 Aug 31 10:00:32.571254 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 504/992] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:32 2022] GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:33.101649 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-2b61a333-17f1-4216-b96e-c6cc8127536d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:33.102343 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-2b61a333-17f1-4216-b96e-c6cc8127536d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:33.108443 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2b61a333-17f1-4216-b96e-c6cc8127536d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:33.108917 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2b61a333-17f1-4216-b96e-c6cc8127536d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:33.109346 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2b61a333-17f1-4216-b96e-c6cc8127536d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:33.110042 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2b61a333-17f1-4216-b96e-c6cc8127536d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:33.110487 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2b61a333-17f1-4216-b96e-c6cc8127536d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:33.110899 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2b61a333-17f1-4216-b96e-c6cc8127536d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:33.252981 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2b61a333-17f1-4216-b96e-c6cc8127536d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:33.262388 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2b61a333-17f1-4216-b96e-c6cc8127536d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:33.263841 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2b61a333-17f1-4216-b96e-c6cc8127536d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:33.265066 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-2b61a333-17f1-4216-b96e-c6cc8127536d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1725 microversion: 2.20 time: 0.167967 Aug 31 10:00:33.265660 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 489/993] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:00:33 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:00:33.591715 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-44d148c9-7861-45d3-b814-713a4dbc09dc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:33.592296 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-44d148c9-7861-45d3-b814-713a4dbc09dc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] [instance: ba84763c-52ec-4d7e-b9e5-2a945c63f426] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:33.598846 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-44d148c9-7861-45d3-b814-713a4dbc09dc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:33.599324 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-44d148c9-7861-45d3-b814-713a4dbc09dc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:33.599753 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-44d148c9-7861-45d3-b814-713a4dbc09dc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:33.600476 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-44d148c9-7861-45d3-b814-713a4dbc09dc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:33.600921 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-44d148c9-7861-45d3-b814-713a4dbc09dc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:33.601335 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-44d148c9-7861-45d3-b814-713a4dbc09dc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:33.774039 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-44d148c9-7861-45d3-b814-713a4dbc09dc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98df7d1938343f081cd4e003fbf43a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdafb29648f34d9cbad378da051ac5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:33.782064 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-44d148c9-7861-45d3-b814-713a4dbc09dc tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] 10.222.0.13 "GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426" status: 200 len: 1314 microversion: 2.1 time: 0.194151 Aug 31 10:00:33.782644 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 505/994] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:33 2022] GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:34.289445 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-55a13321-0bc3-4afb-85ca-1e4242c86828 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:34.290152 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-55a13321-0bc3-4afb-85ca-1e4242c86828 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:34.296652 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-55a13321-0bc3-4afb-85ca-1e4242c86828 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:34.297137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-55a13321-0bc3-4afb-85ca-1e4242c86828 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:34.297606 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-55a13321-0bc3-4afb-85ca-1e4242c86828 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:34.298305 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-55a13321-0bc3-4afb-85ca-1e4242c86828 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:34.298756 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-55a13321-0bc3-4afb-85ca-1e4242c86828 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:34.299174 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-55a13321-0bc3-4afb-85ca-1e4242c86828 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:34.594580 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-55a13321-0bc3-4afb-85ca-1e4242c86828 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:34.604950 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-55a13321-0bc3-4afb-85ca-1e4242c86828 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:34.607041 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-55a13321-0bc3-4afb-85ca-1e4242c86828 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:34.607899 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-55a13321-0bc3-4afb-85ca-1e4242c86828 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1725 microversion: 2.20 time: 0.323709 Aug 31 10:00:34.608768 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 490/995] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:00:34 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1725 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:00:34.805032 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-6ffa4bde-7a90-4657-bb3f-f6e1d7ba83e3 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:34.806358 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-6ffa4bde-7a90-4657-bb3f-f6e1d7ba83e3 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] [instance: ba84763c-52ec-4d7e-b9e5-2a945c63f426] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:34.814489 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ffa4bde-7a90-4657-bb3f-f6e1d7ba83e3 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:34.814683 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ffa4bde-7a90-4657-bb3f-f6e1d7ba83e3 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:34.815315 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ffa4bde-7a90-4657-bb3f-f6e1d7ba83e3 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:34.816247 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ffa4bde-7a90-4657-bb3f-f6e1d7ba83e3 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:34.816711 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ffa4bde-7a90-4657-bb3f-f6e1d7ba83e3 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:34.817100 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6ffa4bde-7a90-4657-bb3f-f6e1d7ba83e3 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:35.292773 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-6ffa4bde-7a90-4657-bb3f-f6e1d7ba83e3 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98df7d1938343f081cd4e003fbf43a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdafb29648f34d9cbad378da051ac5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:35.300695 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-6ffa4bde-7a90-4657-bb3f-f6e1d7ba83e3 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] 10.222.0.13 "GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426" status: 200 len: 1314 microversion: 2.1 time: 0.500998 Aug 31 10:00:35.301358 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 506/996] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:34 2022] GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426 => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:35.441953 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-83c50b43-83e5-47c2-913e-90095d225776 req-adf840b4-1cde-46cd-890f-9ef42b0e7f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9", "name": "network-vif-deleted", "tag": "f0ab5d21-97ec-4a21-a75b-253b40f65e47"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:00:35.452291 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-83c50b43-83e5-47c2-913e-90095d225776 req-adf840b4-1cde-46cd-890f-9ef42b0e7f41 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:35.452760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-83c50b43-83e5-47c2-913e-90095d225776 req-adf840b4-1cde-46cd-890f-9ef42b0e7f41 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:35.453259 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-83c50b43-83e5-47c2-913e-90095d225776 req-adf840b4-1cde-46cd-890f-9ef42b0e7f41 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:35.464992 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-83c50b43-83e5-47c2-913e-90095d225776 req-adf840b4-1cde-46cd-890f-9ef42b0e7f41 service nova] Creating event network-vif-deleted:f0ab5d21-97ec-4a21-a75b-253b40f65e47 for instance b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 on hv-cinder-84496 Aug 31 10:00:35.470255 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-83c50b43-83e5-47c2-913e-90095d225776 req-adf840b4-1cde-46cd-890f-9ef42b0e7f41 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032175 Aug 31 10:00:35.470853 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 491/997] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 10:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:00:35.634505 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-d69f4bc9-99f3-49e0-aca0-e0909e1c5a40 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:35.635128 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-d69f4bc9-99f3-49e0-aca0-e0909e1c5a40 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:35.641404 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d69f4bc9-99f3-49e0-aca0-e0909e1c5a40 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:35.641897 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d69f4bc9-99f3-49e0-aca0-e0909e1c5a40 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:35.642322 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d69f4bc9-99f3-49e0-aca0-e0909e1c5a40 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:35.643031 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d69f4bc9-99f3-49e0-aca0-e0909e1c5a40 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:35.643476 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d69f4bc9-99f3-49e0-aca0-e0909e1c5a40 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:35.643898 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d69f4bc9-99f3-49e0-aca0-e0909e1c5a40 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:35.708890 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-d69f4bc9-99f3-49e0-aca0-e0909e1c5a40 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:35.717912 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-d69f4bc9-99f3-49e0-aca0-e0909e1c5a40 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:35.719379 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-d69f4bc9-99f3-49e0-aca0-e0909e1c5a40 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:35.720574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-d69f4bc9-99f3-49e0-aca0-e0909e1c5a40 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1657 microversion: 2.20 time: 0.091066 Aug 31 10:00:35.721135 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 507/998] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:00:35 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1657 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:00:36.323312 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-e855fceb-7e83-4cce-8dcc-9ba29b5f32b0 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:36.324056 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-e855fceb-7e83-4cce-8dcc-9ba29b5f32b0 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] [instance: ba84763c-52ec-4d7e-b9e5-2a945c63f426] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:36.330766 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e855fceb-7e83-4cce-8dcc-9ba29b5f32b0 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:36.331264 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e855fceb-7e83-4cce-8dcc-9ba29b5f32b0 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:36.331695 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e855fceb-7e83-4cce-8dcc-9ba29b5f32b0 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:36.332397 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e855fceb-7e83-4cce-8dcc-9ba29b5f32b0 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:36.332856 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e855fceb-7e83-4cce-8dcc-9ba29b5f32b0 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:36.333276 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e855fceb-7e83-4cce-8dcc-9ba29b5f32b0 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:36.481663 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-e855fceb-7e83-4cce-8dcc-9ba29b5f32b0 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98df7d1938343f081cd4e003fbf43a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdafb29648f34d9cbad378da051ac5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:36.489796 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-e855fceb-7e83-4cce-8dcc-9ba29b5f32b0 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] 10.222.0.13 "GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426" status: 200 len: 1314 microversion: 2.1 time: 0.171556 Aug 31 10:00:36.490377 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 492/999] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:36 2022] GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:36.745033 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-de40d6fb-b6d2-4e58-8d4f-760a1e25d524 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:36.745653 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-de40d6fb-b6d2-4e58-8d4f-760a1e25d524 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:36.752154 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-de40d6fb-b6d2-4e58-8d4f-760a1e25d524 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:36.752625 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-de40d6fb-b6d2-4e58-8d4f-760a1e25d524 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:36.753047 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-de40d6fb-b6d2-4e58-8d4f-760a1e25d524 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:36.753785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-de40d6fb-b6d2-4e58-8d4f-760a1e25d524 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:36.754227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-de40d6fb-b6d2-4e58-8d4f-760a1e25d524 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:36.754639 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-de40d6fb-b6d2-4e58-8d4f-760a1e25d524 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:36.820214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-de40d6fb-b6d2-4e58-8d4f-760a1e25d524 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:36.828637 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-de40d6fb-b6d2-4e58-8d4f-760a1e25d524 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:36.830152 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-de40d6fb-b6d2-4e58-8d4f-760a1e25d524 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:36.831345 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-de40d6fb-b6d2-4e58-8d4f-760a1e25d524 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 200 len: 1657 microversion: 2.20 time: 0.090875 Aug 31 10:00:36.832718 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 508/1000] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:00:36 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 1657 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:00:37.512150 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-fa3e529c-b0d8-4159-b326-3dc671d52d60 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:37.512775 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-fa3e529c-b0d8-4159-b326-3dc671d52d60 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] [instance: ba84763c-52ec-4d7e-b9e5-2a945c63f426] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:37.519693 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fa3e529c-b0d8-4159-b326-3dc671d52d60 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:37.520205 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fa3e529c-b0d8-4159-b326-3dc671d52d60 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:37.520637 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fa3e529c-b0d8-4159-b326-3dc671d52d60 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:37.526142 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fa3e529c-b0d8-4159-b326-3dc671d52d60 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:37.526142 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fa3e529c-b0d8-4159-b326-3dc671d52d60 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:37.526142 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fa3e529c-b0d8-4159-b326-3dc671d52d60 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:37.661840 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-fa3e529c-b0d8-4159-b326-3dc671d52d60 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98df7d1938343f081cd4e003fbf43a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdafb29648f34d9cbad378da051ac5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:37.670443 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-fa3e529c-b0d8-4159-b326-3dc671d52d60 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] 10.222.0.13 "GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426" status: 200 len: 1314 microversion: 2.1 time: 0.162256 Aug 31 10:00:37.671307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 493/1001] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:37 2022] GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:37.861911 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-69b0d629-88a0-47b1-8b26-f0700f597535 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:37.862467 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-69b0d629-88a0-47b1-8b26-f0700f597535 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:37.870403 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-69b0d629-88a0-47b1-8b26-f0700f597535 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:37.870904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-69b0d629-88a0-47b1-8b26-f0700f597535 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:37.871310 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-69b0d629-88a0-47b1-8b26-f0700f597535 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:37.872021 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-69b0d629-88a0-47b1-8b26-f0700f597535 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:37.872465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-69b0d629-88a0-47b1-8b26-f0700f597535 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:37.872876 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-69b0d629-88a0-47b1-8b26-f0700f597535 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:37.887265 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-69b0d629-88a0-47b1-8b26-f0700f597535 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] HTTP exception thrown: Instance b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 could not be found. Aug 31 10:00:37.888816 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-69b0d629-88a0-47b1-8b26-f0700f597535 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Request method failure captured: Aug 31 10:00:37.888816 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 HTTP/1.1 Aug 31 10:00:37.888816 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 10:00:37.888816 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 10:00:37.888816 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 10:00:37.888816 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 10:00:37.888816 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 10:00:37.888816 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 10:00:37.888816 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 10:00:37.888816 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 10:00:37.888816 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDzA7RlgTqPbJ9x6G0d-icAmjdYoPScrNsrptUHwqdSDU1jyZjMduoMif0Yt1IPs0AW80HY2woB2gsC1-lK-cDpj7S0ZbQD96sNUp_78FGLaQTbAH1oaAb119vxMKAGYTUbI2NFyXAVZ1QC9EzH4PsDkEWeDAfeeTiE6hZBrrVlf2rU8 Aug 31 10:00:37.888816 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 10:00:37.888816 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 10:00:37.888816 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 10:00:37.888816 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 10:00:37.888816 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 10:00:37.888816 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 10:00:37.888816 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 10:00:37.888816 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: a68bf51dcd404f559e9ae2efeb185712 Aug 31 10:00:37.888816 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2121567059 Aug 31 10:00:37.888816 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 10:00:37.888816 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 10:00:37.890662 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a68bf51dcd404f559e9ae2efeb185712"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a68bf51dcd404f559e9ae2efeb185712"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a68bf51dcd404f559e9ae2efeb185712"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a68bf51dcd404f559e9ae2efeb185712"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 10:00:37.890662 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2121567059 Aug 31 10:00:37.890662 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: a68bf51dcd404f559e9ae2efeb185712 Aug 31 10:00:37.890662 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2121567059 Aug 31 10:00:37.890662 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-AttachVolumeShelveTestJSON-2121567059-project Aug 31 10:00:37.890662 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 10:00:37.890662 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 10:00:37.890662 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: 6dc6f70f3b1b40d9be1f9d01da0de1f1 Aug 31 10:00:37.890662 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2121567059-project Aug 31 10:00:37.890662 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 10:00:37.890662 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Instance b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 could not be found. Aug 31 10:00:37.890662 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': 'b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9'} Aug 31 10:00:37.891654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:00:37.891654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:37.891654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:00:37.891654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:00:37.891654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:00:37.891654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:00:37.891654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:00:37.891654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:00:37.891654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:00:37.891654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:00:37.891654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 could not be found. Aug 31 10:00:37.891654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:00:37.891654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:00:37.891654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:00:37.891654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:37.891654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:00:37.891654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:00:37.891654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:00:37.891654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:00:37.891654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:00:37.893281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:00:37.893281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:00:37.893281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:00:37.893281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:00:37.893281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:00:37.893281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:00:37.893281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:00:37.893281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 could not be found. Aug 31 10:00:37.893281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:00:37.893281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:00:37.893281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:00:37.893281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:37.893281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:00:37.893281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:00:37.893281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:00:37.893281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:00:37.893281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 could not be found. Aug 31 10:00:37.893281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:00:37.894818 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-69b0d629-88a0-47b1-8b26-f0700f597535 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Returning 404 to user: Instance b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:00:37.894818 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-69b0d629-88a0-47b1-8b26-f0700f597535 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 404 len: 111 microversion: 2.20 time: 0.032423 Aug 31 10:00:37.894818 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 509/1002] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:00:37 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 10:00:37.900581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-a94582d1-0d0d-4c05-b35c-c1fefd680344 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '.version_select at 0x7f5503eb6a60>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:37.922363 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-a94582d1-0d0d-4c05-b35c-c1fefd680344 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-552878975" status: 204 len: 0 microversion: 2.20 time: 0.025531 Aug 31 10:00:37.922990 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 494/1003] 10.222.0.13 () {60 vars in 1259 bytes} [Wed Aug 31 10:00:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-552878975 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 10:00:38.583199 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-238e917b-3750-4b21-ac45-ba1911eee532 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Action: 'create', calling method: .version_select at 0x7f5503cd5af0>, body: {"keypair": {"name": "tempest-keypair-413083005", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYdVimHf34J4Lw01hxCfPLF65FJ8vc2KpnwRC90yUvaYQekO0vHPf1DwAH0ubiz3yqwLGLrtCdG95alG8tHlNUEzsH1WrMfANXX+e+p22woB0KHKxwMzM89Yc4SDI+jQA=="}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:00:38.603796 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-238e917b-3750-4b21-ac45-ba1911eee532 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Getting quotas for project a68bf51dcd404f559e9ae2efeb185712. Resources: {'key_pairs'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:00:38.607702 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-238e917b-3750-4b21-ac45-ba1911eee532 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Getting quotas for user 6dc6f70f3b1b40d9be1f9d01da0de1f1 and project a68bf51dcd404f559e9ae2efeb185712. Resources: {'key_pairs'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:00:38.620597 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR oslo.messaging._drivers.impl_rabbit [None req-238e917b-3750-4b21-ac45-ba1911eee532 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [d200a3dd-84f2-4054-8bb4-7fba0ac3f2aa] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 10:00:38.693060 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-a8c7ea53-50bf-4613-8cf5-c989f00fec03 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:38.693689 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-a8c7ea53-50bf-4613-8cf5-c989f00fec03 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] [instance: ba84763c-52ec-4d7e-b9e5-2a945c63f426] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:38.700594 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a8c7ea53-50bf-4613-8cf5-c989f00fec03 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:38.701086 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a8c7ea53-50bf-4613-8cf5-c989f00fec03 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:38.701555 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a8c7ea53-50bf-4613-8cf5-c989f00fec03 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:38.702256 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a8c7ea53-50bf-4613-8cf5-c989f00fec03 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:38.702708 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a8c7ea53-50bf-4613-8cf5-c989f00fec03 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:38.703129 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a8c7ea53-50bf-4613-8cf5-c989f00fec03 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:38.836518 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-a8c7ea53-50bf-4613-8cf5-c989f00fec03 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98df7d1938343f081cd4e003fbf43a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdafb29648f34d9cbad378da051ac5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:38.844400 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-a8c7ea53-50bf-4613-8cf5-c989f00fec03 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] 10.222.0.13 "GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426" status: 200 len: 1314 microversion: 2.1 time: 0.156067 Aug 31 10:00:38.855122 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 495/1004] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:38 2022] GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:00:38.957719 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=2 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:39.627421 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO oslo.messaging._drivers.impl_rabbit [None req-238e917b-3750-4b21-ac45-ba1911eee532 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [d200a3dd-84f2-4054-8bb4-7fba0ac3f2aa] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 48804. Aug 31 10:00:39.642270 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-238e917b-3750-4b21-ac45-ba1911eee532 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.062961 Aug 31 10:00:39.642861 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 510/1005] 10.222.0.13 () {62 vars in 1200 bytes} [Wed Aug 31 10:00:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1064 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 10:00:39.865446 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-83b0081a-5c91-4b00-b21e-b6a87f17848b tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:39.866997 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-83b0081a-5c91-4b00-b21e-b6a87f17848b tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] [instance: ba84763c-52ec-4d7e-b9e5-2a945c63f426] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:39.874033 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-83b0081a-5c91-4b00-b21e-b6a87f17848b tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:39.874777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-83b0081a-5c91-4b00-b21e-b6a87f17848b tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:39.875388 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-83b0081a-5c91-4b00-b21e-b6a87f17848b tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:39.876352 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-83b0081a-5c91-4b00-b21e-b6a87f17848b tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:39.876811 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-83b0081a-5c91-4b00-b21e-b6a87f17848b tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:39.877228 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-83b0081a-5c91-4b00-b21e-b6a87f17848b tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:40.041160 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-83b0081a-5c91-4b00-b21e-b6a87f17848b tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98df7d1938343f081cd4e003fbf43a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdafb29648f34d9cbad378da051ac5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:40.050661 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-83b0081a-5c91-4b00-b21e-b6a87f17848b tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] 10.222.0.13 "GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426" status: 200 len: 1314 microversion: 2.1 time: 0.189461 Aug 31 10:00:40.051258 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 496/1006] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:39 2022] GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:40.888344 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-2bc877d9-16ee-467f-bbaa-b1326d4de7a0 req-252fef60-1695-462f-b110-4809ee771467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba84763c-52ec-4d7e-b9e5-2a945c63f426", "name": "network-vif-plugged", "status": "completed", "tag": "2ab97470-728c-4977-b280-3db1e3c28e5c"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:00:40.907084 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-2bc877d9-16ee-467f-bbaa-b1326d4de7a0 req-252fef60-1695-462f-b110-4809ee771467 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:40.907802 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-2bc877d9-16ee-467f-bbaa-b1326d4de7a0 req-252fef60-1695-462f-b110-4809ee771467 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:40.908685 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-2bc877d9-16ee-467f-bbaa-b1326d4de7a0 req-252fef60-1695-462f-b110-4809ee771467 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:40.922230 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-2bc877d9-16ee-467f-bbaa-b1326d4de7a0 req-252fef60-1695-462f-b110-4809ee771467 service nova] Creating event network-vif-plugged:2ab97470-728c-4977-b280-3db1e3c28e5c for instance ba84763c-52ec-4d7e-b9e5-2a945c63f426 on hv-cinder-84496 Aug 31 10:00:40.930021 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-2bc877d9-16ee-467f-bbaa-b1326d4de7a0 req-252fef60-1695-462f-b110-4809ee771467 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044777 Aug 31 10:00:40.930895 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 511/1007] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 10:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:00:40.993552 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-34651c02-9e8f-4753-addf-aaae1b31c6d2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1926433417", "imageRef": "8e078bb9-f274-4984-8128-d31407d49604", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0f5370f1-004e-40df-a622-c79b4bbd1b36"}], "security_groups": [{"name": "tempest-securitygroup--1346118660"}], "key_name": "tempest-keypair-413083005", "user_data": "}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:00:41.072682 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-20f95653-e927-43d8-bdfd-f328b34e084b tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:41.073413 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-20f95653-e927-43d8-bdfd-f328b34e084b tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] [instance: ba84763c-52ec-4d7e-b9e5-2a945c63f426] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:41.079723 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-20f95653-e927-43d8-bdfd-f328b34e084b tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:41.080214 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-20f95653-e927-43d8-bdfd-f328b34e084b tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:41.080651 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-20f95653-e927-43d8-bdfd-f328b34e084b tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:41.081359 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-20f95653-e927-43d8-bdfd-f328b34e084b tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:41.081841 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-20f95653-e927-43d8-bdfd-f328b34e084b tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:41.082298 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-20f95653-e927-43d8-bdfd-f328b34e084b tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:41.108565 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.network.neutron [None req-34651c02-9e8f-4753-addf-aaae1b31c6d2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] validate_networks() for [('0f5370f1-004e-40df-a622-c79b4bbd1b36', None, None, None, None, None)] {{(pid=127171) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 10:00:41.385612 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-20f95653-e927-43d8-bdfd-f328b34e084b tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98df7d1938343f081cd4e003fbf43a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdafb29648f34d9cbad378da051ac5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:41.393884 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-20f95653-e927-43d8-bdfd-f328b34e084b tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] 10.222.0.13 "GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426" status: 200 len: 1314 microversion: 2.1 time: 0.326012 Aug 31 10:00:41.394498 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 512/1008] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:41 2022] GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:00:41.636651 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-34651c02-9e8f-4753-addf-aaae1b31c6d2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Flavor limits 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 10:00:41.637123 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-34651c02-9e8f-4753-addf-aaae1b31c6d2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Image limits 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 10:00:41.637690 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-34651c02-9e8f-4753-addf-aaae1b31c6d2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Flavor pref 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 10:00:41.638096 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-34651c02-9e8f-4753-addf-aaae1b31c6d2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Image pref 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 10:00:41.638500 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-34651c02-9e8f-4753-addf-aaae1b31c6d2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 10:00:41.647214 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-34651c02-9e8f-4753-addf-aaae1b31c6d2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:41.647690 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-34651c02-9e8f-4753-addf-aaae1b31c6d2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:41.648113 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-34651c02-9e8f-4753-addf-aaae1b31c6d2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:41.648825 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-34651c02-9e8f-4753-addf-aaae1b31c6d2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:41.649261 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-34651c02-9e8f-4753-addf-aaae1b31c6d2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:41.649696 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-34651c02-9e8f-4753-addf-aaae1b31c6d2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:41.666627 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-34651c02-9e8f-4753-addf-aaae1b31c6d2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Getting quotas for project a68bf51dcd404f559e9ae2efeb185712. Resources: {'ram', 'instances', 'cores'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:00:41.670607 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-34651c02-9e8f-4753-addf-aaae1b31c6d2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Getting quotas for user 6dc6f70f3b1b40d9be1f9d01da0de1f1 and project a68bf51dcd404f559e9ae2efeb185712. Resources: {'ram', 'instances', 'cores'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:00:41.682954 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-34651c02-9e8f-4753-addf-aaae1b31c6d2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Going to run 1 instances... {{(pid=127171) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 10:00:41.684797 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-34651c02-9e8f-4753-addf-aaae1b31c6d2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8e078bb9-f274-4984-8128-d31407d49604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 10:00:41.733795 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-34651c02-9e8f-4753-addf-aaae1b31c6d2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.745027 Aug 31 10:00:41.734441 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 497/1009] 10.222.0.13 () {62 vars in 1188 bytes} [Wed Aug 31 10:00:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 10:00:41.746779 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-212fa553-6d87-4d9a-8879-10ec17374a1c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:41.747414 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-212fa553-6d87-4d9a-8879-10ec17374a1c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:41.803794 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-212fa553-6d87-4d9a-8879-10ec17374a1c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:41.812771 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-212fa553-6d87-4d9a-8879-10ec17374a1c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:41.814272 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-212fa553-6d87-4d9a-8879-10ec17374a1c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:41.815389 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-212fa553-6d87-4d9a-8879-10ec17374a1c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1281 microversion: 2.20 time: 0.072528 Aug 31 10:00:41.815944 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 513/1010] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:00:41 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:00:42.416926 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9fff35ef-55b2-4146-a45d-b7b9db9504f7 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:42.417503 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-9fff35ef-55b2-4146-a45d-b7b9db9504f7 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] [instance: ba84763c-52ec-4d7e-b9e5-2a945c63f426] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:42.423740 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9fff35ef-55b2-4146-a45d-b7b9db9504f7 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:42.424218 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9fff35ef-55b2-4146-a45d-b7b9db9504f7 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:42.424644 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9fff35ef-55b2-4146-a45d-b7b9db9504f7 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:42.425323 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9fff35ef-55b2-4146-a45d-b7b9db9504f7 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:42.425806 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9fff35ef-55b2-4146-a45d-b7b9db9504f7 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:42.426220 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9fff35ef-55b2-4146-a45d-b7b9db9504f7 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:42.567843 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-9fff35ef-55b2-4146-a45d-b7b9db9504f7 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98df7d1938343f081cd4e003fbf43a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdafb29648f34d9cbad378da051ac5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:42.576191 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-9fff35ef-55b2-4146-a45d-b7b9db9504f7 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] 10.222.0.13 "GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426" status: 200 len: 1314 microversion: 2.1 time: 0.164527 Aug 31 10:00:42.576779 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 498/1011] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:42 2022] GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:42.838368 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-38a97100-99d9-455a-be25-84b3e0d70361 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:42.838996 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-38a97100-99d9-455a-be25-84b3e0d70361 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:42.846730 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-38a97100-99d9-455a-be25-84b3e0d70361 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:42.847223 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-38a97100-99d9-455a-be25-84b3e0d70361 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:42.847653 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-38a97100-99d9-455a-be25-84b3e0d70361 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:42.848445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-38a97100-99d9-455a-be25-84b3e0d70361 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:42.849013 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-38a97100-99d9-455a-be25-84b3e0d70361 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:42.849455 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-38a97100-99d9-455a-be25-84b3e0d70361 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:42.915554 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-38a97100-99d9-455a-be25-84b3e0d70361 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:42.923760 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-38a97100-99d9-455a-be25-84b3e0d70361 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:42.925226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-38a97100-99d9-455a-be25-84b3e0d70361 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:42.926360 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-38a97100-99d9-455a-be25-84b3e0d70361 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1333 microversion: 2.20 time: 0.091948 Aug 31 10:00:42.926910 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 514/1012] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:00:42 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:00:43.597760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-7b50c27a-bfe2-423c-8a86-cfcd67aae6fd tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:43.598366 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-7b50c27a-bfe2-423c-8a86-cfcd67aae6fd tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] [instance: ba84763c-52ec-4d7e-b9e5-2a945c63f426] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:43.605973 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7b50c27a-bfe2-423c-8a86-cfcd67aae6fd tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:43.606461 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7b50c27a-bfe2-423c-8a86-cfcd67aae6fd tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:43.606893 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7b50c27a-bfe2-423c-8a86-cfcd67aae6fd tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:43.607589 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7b50c27a-bfe2-423c-8a86-cfcd67aae6fd tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:43.608035 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7b50c27a-bfe2-423c-8a86-cfcd67aae6fd tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:43.608457 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7b50c27a-bfe2-423c-8a86-cfcd67aae6fd tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:43.739596 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7b50c27a-bfe2-423c-8a86-cfcd67aae6fd tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98df7d1938343f081cd4e003fbf43a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdafb29648f34d9cbad378da051ac5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:43.749331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-7b50c27a-bfe2-423c-8a86-cfcd67aae6fd tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] 10.222.0.13 "GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426" status: 200 len: 1464 microversion: 2.1 time: 0.155408 Aug 31 10:00:43.749954 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 499/1013] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:43 2022] GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426 => generated 1464 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:43.796454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b7a69e09-3385-46dd-af17-74d3cb253158 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:43.796947 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b7a69e09-3385-46dd-af17-74d3cb253158 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] [instance: ba84763c-52ec-4d7e-b9e5-2a945c63f426] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:43.804155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b7a69e09-3385-46dd-af17-74d3cb253158 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:43.804155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b7a69e09-3385-46dd-af17-74d3cb253158 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:43.805013 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b7a69e09-3385-46dd-af17-74d3cb253158 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:43.805745 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b7a69e09-3385-46dd-af17-74d3cb253158 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:43.806193 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b7a69e09-3385-46dd-af17-74d3cb253158 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:43.806609 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b7a69e09-3385-46dd-af17-74d3cb253158 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:43.833546 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b7a69e09-3385-46dd-af17-74d3cb253158 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] [instance: ba84763c-52ec-4d7e-b9e5-2a945c63f426] Going to try to terminate instance {{(pid=127170) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 10:00:43.921270 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b7a69e09-3385-46dd-af17-74d3cb253158 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426" status: 204 len: 0 microversion: 2.1 time: 0.128524 Aug 31 10:00:43.927299 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 515/1014] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 10:00:43 2022] DELETE /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 10:00:43.934604 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-e9f71263-bd09-4924-9148-a5cd263a408c tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:43.935666 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-e9f71263-bd09-4924-9148-a5cd263a408c tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] [instance: ba84763c-52ec-4d7e-b9e5-2a945c63f426] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:43.942730 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e9f71263-bd09-4924-9148-a5cd263a408c tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:43.943229 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e9f71263-bd09-4924-9148-a5cd263a408c tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:43.945130 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e9f71263-bd09-4924-9148-a5cd263a408c tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:43.946176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e9f71263-bd09-4924-9148-a5cd263a408c tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:43.946907 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e9f71263-bd09-4924-9148-a5cd263a408c tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:43.947562 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e9f71263-bd09-4924-9148-a5cd263a408c tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:43.952983 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-4a8232dd-a051-485f-a4e7-5e01076a553d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:43.952983 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-4a8232dd-a051-485f-a4e7-5e01076a553d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:43.954514 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:43.963003 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4a8232dd-a051-485f-a4e7-5e01076a553d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:43.963003 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4a8232dd-a051-485f-a4e7-5e01076a553d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:43.963493 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4a8232dd-a051-485f-a4e7-5e01076a553d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:43.964392 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4a8232dd-a051-485f-a4e7-5e01076a553d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:43.965303 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4a8232dd-a051-485f-a4e7-5e01076a553d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:43.965303 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4a8232dd-a051-485f-a4e7-5e01076a553d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:44.085227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-4a8232dd-a051-485f-a4e7-5e01076a553d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:44.093847 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-4a8232dd-a051-485f-a4e7-5e01076a553d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:44.095274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-4a8232dd-a051-485f-a4e7-5e01076a553d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:44.096371 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-4a8232dd-a051-485f-a4e7-5e01076a553d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1341 microversion: 2.20 time: 0.149538 Aug 31 10:00:44.109406 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 516/1015] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:00:43 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1341 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 10:00:44.146369 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-e9f71263-bd09-4924-9148-a5cd263a408c tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98df7d1938343f081cd4e003fbf43a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdafb29648f34d9cbad378da051ac5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:44.155323 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-e9f71263-bd09-4924-9148-a5cd263a408c tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] 10.222.0.13 "GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426" status: 200 len: 1470 microversion: 2.1 time: 0.225653 Aug 31 10:00:44.155890 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 500/1016] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:43 2022] GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426 => generated 1470 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:45.120800 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-79756e7e-3e19-4b24-a689-43408d356f7d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:45.121434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-79756e7e-3e19-4b24-a689-43408d356f7d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:45.128154 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-79756e7e-3e19-4b24-a689-43408d356f7d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:45.128646 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-79756e7e-3e19-4b24-a689-43408d356f7d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:45.129080 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-79756e7e-3e19-4b24-a689-43408d356f7d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:45.129846 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-79756e7e-3e19-4b24-a689-43408d356f7d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:45.130274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-79756e7e-3e19-4b24-a689-43408d356f7d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:45.130703 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-79756e7e-3e19-4b24-a689-43408d356f7d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:45.180404 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-87bd6fda-362f-44c9-a4d2-2e2a19b93735 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:45.181215 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-87bd6fda-362f-44c9-a4d2-2e2a19b93735 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] [instance: ba84763c-52ec-4d7e-b9e5-2a945c63f426] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:45.190611 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-87bd6fda-362f-44c9-a4d2-2e2a19b93735 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:45.191370 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-87bd6fda-362f-44c9-a4d2-2e2a19b93735 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:45.192208 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-87bd6fda-362f-44c9-a4d2-2e2a19b93735 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:45.194318 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-87bd6fda-362f-44c9-a4d2-2e2a19b93735 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:45.195326 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-87bd6fda-362f-44c9-a4d2-2e2a19b93735 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:45.196305 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-87bd6fda-362f-44c9-a4d2-2e2a19b93735 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:45.219753 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-79756e7e-3e19-4b24-a689-43408d356f7d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:45.223673 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:45.231045 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-79756e7e-3e19-4b24-a689-43408d356f7d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:45.232558 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-79756e7e-3e19-4b24-a689-43408d356f7d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:45.233975 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-79756e7e-3e19-4b24-a689-43408d356f7d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1351 microversion: 2.20 time: 0.117176 Aug 31 10:00:45.240582 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 517/1017] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:00:45 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1351 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 10:00:45.452385 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-87bd6fda-362f-44c9-a4d2-2e2a19b93735 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98df7d1938343f081cd4e003fbf43a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdafb29648f34d9cbad378da051ac5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:45.461031 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-87bd6fda-362f-44c9-a4d2-2e2a19b93735 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] 10.222.0.13 "GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426" status: 200 len: 1470 microversion: 2.1 time: 0.288000 Aug 31 10:00:45.461657 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 501/1018] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:45 2022] GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426 => generated 1470 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:00:46.258618 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-7284f4bc-d17d-40c7-9cb7-5b0507c3bc82 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:46.259244 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-7284f4bc-d17d-40c7-9cb7-5b0507c3bc82 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:46.273560 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7284f4bc-d17d-40c7-9cb7-5b0507c3bc82 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:46.274044 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7284f4bc-d17d-40c7-9cb7-5b0507c3bc82 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:46.274588 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7284f4bc-d17d-40c7-9cb7-5b0507c3bc82 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:46.275318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7284f4bc-d17d-40c7-9cb7-5b0507c3bc82 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:46.275768 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7284f4bc-d17d-40c7-9cb7-5b0507c3bc82 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:46.276186 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7284f4bc-d17d-40c7-9cb7-5b0507c3bc82 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:46.482597 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-5c6dd246-638e-46f6-8f93-b1b6cd2a7a6c tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:46.483134 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-5c6dd246-638e-46f6-8f93-b1b6cd2a7a6c tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] [instance: ba84763c-52ec-4d7e-b9e5-2a945c63f426] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:46.490115 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5c6dd246-638e-46f6-8f93-b1b6cd2a7a6c tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:46.491341 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5c6dd246-638e-46f6-8f93-b1b6cd2a7a6c tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:46.491947 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5c6dd246-638e-46f6-8f93-b1b6cd2a7a6c tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:46.492705 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5c6dd246-638e-46f6-8f93-b1b6cd2a7a6c tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:46.493168 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5c6dd246-638e-46f6-8f93-b1b6cd2a7a6c tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:46.493627 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5c6dd246-638e-46f6-8f93-b1b6cd2a7a6c tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:46.724659 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-7284f4bc-d17d-40c7-9cb7-5b0507c3bc82 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:46.735333 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-7284f4bc-d17d-40c7-9cb7-5b0507c3bc82 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:46.736928 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-7284f4bc-d17d-40c7-9cb7-5b0507c3bc82 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:46.738780 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-7284f4bc-d17d-40c7-9cb7-5b0507c3bc82 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1407 microversion: 2.20 time: 0.484281 Aug 31 10:00:46.756930 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 518/1019] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:00:46 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1407 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:00:46.836758 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-5c6dd246-638e-46f6-8f93-b1b6cd2a7a6c tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e98df7d1938343f081cd4e003fbf43a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdafb29648f34d9cbad378da051ac5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:46.845981 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-5c6dd246-638e-46f6-8f93-b1b6cd2a7a6c tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] 10.222.0.13 "GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426" status: 200 len: 1470 microversion: 2.1 time: 0.367174 Aug 31 10:00:46.846878 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 502/1020] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:46 2022] GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426 => generated 1470 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:00:46.934208 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-7a93699e-058e-4ef6-bc75-6ad3ad4e7e62 req-f390b4d5-53f9-4ac6-86dc-607c4089c88b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba84763c-52ec-4d7e-b9e5-2a945c63f426", "name": "network-vif-deleted", "tag": "2ab97470-728c-4977-b280-3db1e3c28e5c"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:00:46.948690 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-7a93699e-058e-4ef6-bc75-6ad3ad4e7e62 req-f390b4d5-53f9-4ac6-86dc-607c4089c88b service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:46.949227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-7a93699e-058e-4ef6-bc75-6ad3ad4e7e62 req-f390b4d5-53f9-4ac6-86dc-607c4089c88b service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:46.949682 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-7a93699e-058e-4ef6-bc75-6ad3ad4e7e62 req-f390b4d5-53f9-4ac6-86dc-607c4089c88b service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:46.967927 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-7a93699e-058e-4ef6-bc75-6ad3ad4e7e62 req-f390b4d5-53f9-4ac6-86dc-607c4089c88b service nova] Creating event network-vif-deleted:2ab97470-728c-4977-b280-3db1e3c28e5c for instance ba84763c-52ec-4d7e-b9e5-2a945c63f426 on hv-cinder-84496 Aug 31 10:00:46.977564 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-7a93699e-058e-4ef6-bc75-6ad3ad4e7e62 req-f390b4d5-53f9-4ac6-86dc-607c4089c88b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051307 Aug 31 10:00:46.978370 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 519/1021] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 10:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:00:47.765090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-2388f425-6333-4c43-8e39-b82e1ea2cdf5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:47.765718 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-2388f425-6333-4c43-8e39-b82e1ea2cdf5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:47.773590 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2388f425-6333-4c43-8e39-b82e1ea2cdf5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:47.774355 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2388f425-6333-4c43-8e39-b82e1ea2cdf5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:47.774854 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2388f425-6333-4c43-8e39-b82e1ea2cdf5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:47.775572 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2388f425-6333-4c43-8e39-b82e1ea2cdf5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:47.776217 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2388f425-6333-4c43-8e39-b82e1ea2cdf5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:47.776649 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2388f425-6333-4c43-8e39-b82e1ea2cdf5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:47.883851 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a1e82eff-126d-4102-93b1-1a29f7cf6216 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:47.884571 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-a1e82eff-126d-4102-93b1-1a29f7cf6216 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] [instance: ba84763c-52ec-4d7e-b9e5-2a945c63f426] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:47.891529 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a1e82eff-126d-4102-93b1-1a29f7cf6216 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:47.892012 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a1e82eff-126d-4102-93b1-1a29f7cf6216 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:47.892445 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a1e82eff-126d-4102-93b1-1a29f7cf6216 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:47.893146 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a1e82eff-126d-4102-93b1-1a29f7cf6216 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:47.893643 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a1e82eff-126d-4102-93b1-1a29f7cf6216 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:47.894046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a1e82eff-126d-4102-93b1-1a29f7cf6216 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:47.909561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-a1e82eff-126d-4102-93b1-1a29f7cf6216 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] HTTP exception thrown: Instance ba84763c-52ec-4d7e-b9e5-2a945c63f426 could not be found. Aug 31 10:00:47.911226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a1e82eff-126d-4102-93b1-1a29f7cf6216 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Request method failure captured: Aug 31 10:00:47.911226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426 HTTP/1.1 Aug 31 10:00:47.911226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 10:00:47.911226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 10:00:47.911226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 10:00:47.911226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 10:00:47.911226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 10:00:47.911226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 10:00:47.911226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 10:00:47.911226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 10:00:47.911226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDzE7ehGOSIsORDErUWTBOvCIH780lwaMDBWRYNgY9lhMkp4qaFKzNnru0uQJOUIEpyc9KBJ8rigBiJ7O3iTHEgZXGZgNr8PqA7YxzcESE3sda1LJ1eYBV_255eud7vaZVt9_IstUVUj0zGmDr6hyMkI7Ve7EIfT5C530j55O3XQI3lE Aug 31 10:00:47.911226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 10:00:47.911226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 10:00:47.911226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 10:00:47.911226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 10:00:47.911226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 10:00:47.911226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 10:00:47.911226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: cdafb29648f34d9cbad378da051ac5c5 Aug 31 10:00:47.911226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-VolumesNegativeTest-1867041824 Aug 31 10:00:47.911226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 10:00:47.911226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 10:00:47.914112 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cdafb29648f34d9cbad378da051ac5c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/cdafb29648f34d9cbad378da051ac5c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cdafb29648f34d9cbad378da051ac5c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_cdafb29648f34d9cbad378da051ac5c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 10:00:47.914112 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-VolumesNegativeTest-1867041824 Aug 31 10:00:47.914112 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: cdafb29648f34d9cbad378da051ac5c5 Aug 31 10:00:47.914112 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-VolumesNegativeTest-1867041824 Aug 31 10:00:47.914112 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-VolumesNegativeTest-1867041824-project Aug 31 10:00:47.914112 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 10:00:47.914112 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 10:00:47.914112 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: e98df7d1938343f081cd4e003fbf43a3 Aug 31 10:00:47.914112 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-VolumesNegativeTest-1867041824-project Aug 31 10:00:47.914112 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 10:00:47.914112 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Instance ba84763c-52ec-4d7e-b9e5-2a945c63f426 could not be found. Aug 31 10:00:47.914112 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': 'ba84763c-52ec-4d7e-b9e5-2a945c63f426'} Aug 31 10:00:47.914989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:00:47.914989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:47.914989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:00:47.914989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:00:47.914989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:00:47.914989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:00:47.914989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:00:47.914989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:00:47.914989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:00:47.914989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:00:47.914989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba84763c-52ec-4d7e-b9e5-2a945c63f426 could not be found. Aug 31 10:00:47.914989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:00:47.914989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:00:47.914989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:00:47.914989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:47.914989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:00:47.914989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:00:47.914989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:00:47.914989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:00:47.914989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:00:47.916309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:00:47.916309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:00:47.916309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:00:47.916309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:00:47.916309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:00:47.916309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:00:47.916309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:00:47.916309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba84763c-52ec-4d7e-b9e5-2a945c63f426 could not be found. Aug 31 10:00:47.916309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:00:47.916309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:00:47.916309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:00:47.916309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:47.916309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:00:47.916309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:00:47.916309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:00:47.916309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:00:47.916309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba84763c-52ec-4d7e-b9e5-2a945c63f426 could not be found. Aug 31 10:00:47.916309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:00:47.917567 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a1e82eff-126d-4102-93b1-1a29f7cf6216 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] Returning 404 to user: Instance ba84763c-52ec-4d7e-b9e5-2a945c63f426 could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:00:47.917567 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a1e82eff-126d-4102-93b1-1a29f7cf6216 tempest-VolumesNegativeTest-1867041824 tempest-VolumesNegativeTest-1867041824-project] 10.222.0.13 "GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426" status: 404 len: 111 microversion: 2.1 time: 0.033485 Aug 31 10:00:47.917567 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 520/1022] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:47 2022] GET /compute/v2.1/servers/ba84763c-52ec-4d7e-b9e5-2a945c63f426 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 10:00:47.996812 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2388f425-6333-4c43-8e39-b82e1ea2cdf5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:48.006340 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2388f425-6333-4c43-8e39-b82e1ea2cdf5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:48.007915 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2388f425-6333-4c43-8e39-b82e1ea2cdf5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:48.009053 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-2388f425-6333-4c43-8e39-b82e1ea2cdf5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1407 microversion: 2.20 time: 0.248447 Aug 31 10:00:48.009656 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 503/1023] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:00:47 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:00:48.998327 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-684b60a0-35af-4e2c-90bb-a6a1a79deb8a req-ab688ae8-3fd6-406c-8593-c6b6c9c7837e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f34e6a94-72da-4a22-bab7-c5edbaae687c", "tag": "8abbd5d9-b7b2-4351-a7a3-78621eab95a0"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:00:49.009153 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-684b60a0-35af-4e2c-90bb-a6a1a79deb8a req-ab688ae8-3fd6-406c-8593-c6b6c9c7837e service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:49.009658 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-684b60a0-35af-4e2c-90bb-a6a1a79deb8a req-ab688ae8-3fd6-406c-8593-c6b6c9c7837e service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:49.010090 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-684b60a0-35af-4e2c-90bb-a6a1a79deb8a req-ab688ae8-3fd6-406c-8593-c6b6c9c7837e service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:49.022603 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-684b60a0-35af-4e2c-90bb-a6a1a79deb8a req-ab688ae8-3fd6-406c-8593-c6b6c9c7837e service nova] Creating event network-changed:8abbd5d9-b7b2-4351-a7a3-78621eab95a0 for instance f34e6a94-72da-4a22-bab7-c5edbaae687c on hv-cinder-84496 Aug 31 10:00:49.027741 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-684b60a0-35af-4e2c-90bb-a6a1a79deb8a req-ab688ae8-3fd6-406c-8593-c6b6c9c7837e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032997 Aug 31 10:00:49.028655 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 521/1024] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 10:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:00:49.033539 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-0e7c73e7-76d5-4e6a-8a56-3dc83810aeac tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:49.034196 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-0e7c73e7-76d5-4e6a-8a56-3dc83810aeac tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:49.041545 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0e7c73e7-76d5-4e6a-8a56-3dc83810aeac tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:49.042036 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0e7c73e7-76d5-4e6a-8a56-3dc83810aeac tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:49.042468 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0e7c73e7-76d5-4e6a-8a56-3dc83810aeac tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:49.043165 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0e7c73e7-76d5-4e6a-8a56-3dc83810aeac tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:49.043616 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0e7c73e7-76d5-4e6a-8a56-3dc83810aeac tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:49.044036 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0e7c73e7-76d5-4e6a-8a56-3dc83810aeac tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:49.186402 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-0e7c73e7-76d5-4e6a-8a56-3dc83810aeac tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:49.195710 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-0e7c73e7-76d5-4e6a-8a56-3dc83810aeac tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:49.197157 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-0e7c73e7-76d5-4e6a-8a56-3dc83810aeac tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:49.198303 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-0e7c73e7-76d5-4e6a-8a56-3dc83810aeac tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1407 microversion: 2.20 time: 0.169159 Aug 31 10:00:49.199062 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 504/1025] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:00:49 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 10:00:50.221970 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-264ac8a3-a01a-4585-bef8-67472782427b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:50.222704 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-264ac8a3-a01a-4585-bef8-67472782427b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:50.229621 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-264ac8a3-a01a-4585-bef8-67472782427b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:50.230093 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-264ac8a3-a01a-4585-bef8-67472782427b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:50.230530 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-264ac8a3-a01a-4585-bef8-67472782427b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:50.231332 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-264ac8a3-a01a-4585-bef8-67472782427b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:50.231783 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-264ac8a3-a01a-4585-bef8-67472782427b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:50.232207 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-264ac8a3-a01a-4585-bef8-67472782427b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:50.678554 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-264ac8a3-a01a-4585-bef8-67472782427b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:50.688867 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-264ac8a3-a01a-4585-bef8-67472782427b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:50.690747 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-264ac8a3-a01a-4585-bef8-67472782427b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:50.691911 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-264ac8a3-a01a-4585-bef8-67472782427b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1407 microversion: 2.20 time: 0.474665 Aug 31 10:00:50.692431 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 522/1026] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:00:50 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1407 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:00:51.715081 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-107c7e96-3e0f-4b83-b254-020049bfad44 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:51.715671 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-107c7e96-3e0f-4b83-b254-020049bfad44 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:51.718104 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=2 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:51.718986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=6 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:51.725717 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-107c7e96-3e0f-4b83-b254-020049bfad44 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:51.726235 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-107c7e96-3e0f-4b83-b254-020049bfad44 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:51.726683 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-107c7e96-3e0f-4b83-b254-020049bfad44 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:51.727395 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-107c7e96-3e0f-4b83-b254-020049bfad44 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:51.727850 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-107c7e96-3e0f-4b83-b254-020049bfad44 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:51.728282 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-107c7e96-3e0f-4b83-b254-020049bfad44 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:51.870529 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-107c7e96-3e0f-4b83-b254-020049bfad44 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:51.879197 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-107c7e96-3e0f-4b83-b254-020049bfad44 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:51.880749 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-107c7e96-3e0f-4b83-b254-020049bfad44 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:51.882615 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-107c7e96-3e0f-4b83-b254-020049bfad44 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1407 microversion: 2.20 time: 0.171497 Aug 31 10:00:51.883212 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 505/1027] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:00:51 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:00:52.908130 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-83db39fc-385a-4874-bd77-fea0d73dea75 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:52.908738 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-83db39fc-385a-4874-bd77-fea0d73dea75 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:52.911203 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=14 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:52.917481 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-83db39fc-385a-4874-bd77-fea0d73dea75 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:52.917968 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-83db39fc-385a-4874-bd77-fea0d73dea75 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:52.918395 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-83db39fc-385a-4874-bd77-fea0d73dea75 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:52.919092 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-83db39fc-385a-4874-bd77-fea0d73dea75 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:52.919539 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-83db39fc-385a-4874-bd77-fea0d73dea75 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:52.919954 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-83db39fc-385a-4874-bd77-fea0d73dea75 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:53.003722 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-bd93ec88-1679-4c30-87af-5e142d5315cd req-d56b5552-48a1-46d2-a858-0c5dfdca9c39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f34e6a94-72da-4a22-bab7-c5edbaae687c", "name": "network-vif-plugged", "status": "completed", "tag": "8abbd5d9-b7b2-4351-a7a3-78621eab95a0"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:00:53.016221 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-bd93ec88-1679-4c30-87af-5e142d5315cd req-d56b5552-48a1-46d2-a858-0c5dfdca9c39 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:53.016784 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-bd93ec88-1679-4c30-87af-5e142d5315cd req-d56b5552-48a1-46d2-a858-0c5dfdca9c39 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:53.017289 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-bd93ec88-1679-4c30-87af-5e142d5315cd req-d56b5552-48a1-46d2-a858-0c5dfdca9c39 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:53.031682 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-bd93ec88-1679-4c30-87af-5e142d5315cd req-d56b5552-48a1-46d2-a858-0c5dfdca9c39 service nova] Creating event network-vif-plugged:8abbd5d9-b7b2-4351-a7a3-78621eab95a0 for instance f34e6a94-72da-4a22-bab7-c5edbaae687c on hv-cinder-84496 Aug 31 10:00:53.036951 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-bd93ec88-1679-4c30-87af-5e142d5315cd req-d56b5552-48a1-46d2-a858-0c5dfdca9c39 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037464 Aug 31 10:00:53.038933 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 506/1028] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 10:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:00:53.086157 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-83db39fc-385a-4874-bd77-fea0d73dea75 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:53.094346 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-83db39fc-385a-4874-bd77-fea0d73dea75 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:53.095795 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-83db39fc-385a-4874-bd77-fea0d73dea75 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:53.096900 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-83db39fc-385a-4874-bd77-fea0d73dea75 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1407 microversion: 2.20 time: 0.192752 Aug 31 10:00:53.097482 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 523/1029] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:00:52 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:00:54.121486 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-e98ebed3-cec3-4f11-b0f4-b0caee7066a3 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:54.122179 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-e98ebed3-cec3-4f11-b0f4-b0caee7066a3 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:54.128832 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e98ebed3-cec3-4f11-b0f4-b0caee7066a3 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:54.129312 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e98ebed3-cec3-4f11-b0f4-b0caee7066a3 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:54.130429 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e98ebed3-cec3-4f11-b0f4-b0caee7066a3 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:54.131781 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e98ebed3-cec3-4f11-b0f4-b0caee7066a3 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:54.132245 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e98ebed3-cec3-4f11-b0f4-b0caee7066a3 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:54.132855 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e98ebed3-cec3-4f11-b0f4-b0caee7066a3 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:54.272949 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-e98ebed3-cec3-4f11-b0f4-b0caee7066a3 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:54.281433 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-e98ebed3-cec3-4f11-b0f4-b0caee7066a3 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:54.282866 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-e98ebed3-cec3-4f11-b0f4-b0caee7066a3 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:54.283993 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-e98ebed3-cec3-4f11-b0f4-b0caee7066a3 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1407 microversion: 2.20 time: 0.167519 Aug 31 10:00:54.284552 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 507/1030] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:00:54 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:00:55.308013 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-55a71fff-c0ee-4778-9bb7-66d6b58ad5d1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:55.308695 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-55a71fff-c0ee-4778-9bb7-66d6b58ad5d1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:55.314735 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-55a71fff-c0ee-4778-9bb7-66d6b58ad5d1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:55.315223 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-55a71fff-c0ee-4778-9bb7-66d6b58ad5d1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:55.315662 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-55a71fff-c0ee-4778-9bb7-66d6b58ad5d1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:55.316360 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-55a71fff-c0ee-4778-9bb7-66d6b58ad5d1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:55.316809 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-55a71fff-c0ee-4778-9bb7-66d6b58ad5d1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:55.317228 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-55a71fff-c0ee-4778-9bb7-66d6b58ad5d1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:55.458005 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-55a71fff-c0ee-4778-9bb7-66d6b58ad5d1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:55.466812 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-55a71fff-c0ee-4778-9bb7-66d6b58ad5d1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:55.468235 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-55a71fff-c0ee-4778-9bb7-66d6b58ad5d1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:55.469429 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-55a71fff-c0ee-4778-9bb7-66d6b58ad5d1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1407 microversion: 2.20 time: 0.166812 Aug 31 10:00:55.469965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 524/1031] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:00:55 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 10:00:56.493017 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-5bd5c446-5a4e-4a62-81d6-b36a901003c9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:56.493686 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-5bd5c446-5a4e-4a62-81d6-b36a901003c9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:56.500898 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5bd5c446-5a4e-4a62-81d6-b36a901003c9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:56.501403 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5bd5c446-5a4e-4a62-81d6-b36a901003c9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:56.501836 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5bd5c446-5a4e-4a62-81d6-b36a901003c9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:56.502531 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5bd5c446-5a4e-4a62-81d6-b36a901003c9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:56.502975 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5bd5c446-5a4e-4a62-81d6-b36a901003c9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:56.503387 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5bd5c446-5a4e-4a62-81d6-b36a901003c9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:56.653763 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-5bd5c446-5a4e-4a62-81d6-b36a901003c9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:56.663741 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-5bd5c446-5a4e-4a62-81d6-b36a901003c9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:56.665063 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-5bd5c446-5a4e-4a62-81d6-b36a901003c9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:56.666254 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-5bd5c446-5a4e-4a62-81d6-b36a901003c9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1599 microversion: 2.20 time: 0.178140 Aug 31 10:00:56.666814 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 508/1032] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:00:56 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1599 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:00:56.688461 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a6088300-8619-4d60-8b65-3cbfd26d1c33 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:56.689059 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-a6088300-8619-4d60-8b65-3cbfd26d1c33 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:56.699684 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a6088300-8619-4d60-8b65-3cbfd26d1c33 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:56.700170 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a6088300-8619-4d60-8b65-3cbfd26d1c33 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:56.700606 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a6088300-8619-4d60-8b65-3cbfd26d1c33 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:56.701304 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a6088300-8619-4d60-8b65-3cbfd26d1c33 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:56.701777 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a6088300-8619-4d60-8b65-3cbfd26d1c33 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:56.702195 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a6088300-8619-4d60-8b65-3cbfd26d1c33 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:56.791794 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a6088300-8619-4d60-8b65-3cbfd26d1c33 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.107273 Aug 31 10:00:56.792422 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 525/1033] 10.222.0.13 () {60 vars in 1316 bytes} [Wed Aug 31 10:00:56 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:00:57.802936 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-82a00055-4682-4749-aab3-4503dd7ff812 req-07934c09-bf23-4f0c-99ae-e411dd33c8f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f34e6a94-72da-4a22-bab7-c5edbaae687c", "tag": "8abbd5d9-b7b2-4351-a7a3-78621eab95a0"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:00:57.818427 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-82a00055-4682-4749-aab3-4503dd7ff812 req-07934c09-bf23-4f0c-99ae-e411dd33c8f7 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:57.819270 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-82a00055-4682-4749-aab3-4503dd7ff812 req-07934c09-bf23-4f0c-99ae-e411dd33c8f7 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:57.820051 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-82a00055-4682-4749-aab3-4503dd7ff812 req-07934c09-bf23-4f0c-99ae-e411dd33c8f7 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:57.837266 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-82a00055-4682-4749-aab3-4503dd7ff812 req-07934c09-bf23-4f0c-99ae-e411dd33c8f7 service nova] Creating event network-changed:8abbd5d9-b7b2-4351-a7a3-78621eab95a0 for instance f34e6a94-72da-4a22-bab7-c5edbaae687c on hv-cinder-84496 Aug 31 10:00:57.846655 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-82a00055-4682-4749-aab3-4503dd7ff812 req-07934c09-bf23-4f0c-99ae-e411dd33c8f7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048962 Aug 31 10:00:57.848116 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 509/1034] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 10:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:01:43.811619 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:01:43.814016 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:01:43.815274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=34 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:01:43.815995 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=50 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:01:43.820526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-94d1389d-7ccf-406b-b4c7-2f38907d594f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:43.825355 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-69153a34-fcac-49f8-8983-72cf9f0e297c req-9144a7b4-2cf7-4457-bb1f-68f1207c6cdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "513a781e-0b66-461a-8d8a-296738d61779", "tag": "bcf607ac-7dab-42c6-8b61-31f31956b33b"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:01:43.826013 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-94d1389d-7ccf-406b-b4c7-2f38907d594f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:43.844578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-94d1389d-7ccf-406b-b4c7-2f38907d594f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:43.844578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-94d1389d-7ccf-406b-b4c7-2f38907d594f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:43.844578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-94d1389d-7ccf-406b-b4c7-2f38907d594f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:43.844578 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-94d1389d-7ccf-406b-b4c7-2f38907d594f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:43.845059 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-94d1389d-7ccf-406b-b4c7-2f38907d594f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:43.845150 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-94d1389d-7ccf-406b-b4c7-2f38907d594f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:43.846105 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-69153a34-fcac-49f8-8983-72cf9f0e297c req-9144a7b4-2cf7-4457-bb1f-68f1207c6cdf service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:43.846593 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-69153a34-fcac-49f8-8983-72cf9f0e297c req-9144a7b4-2cf7-4457-bb1f-68f1207c6cdf service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:43.847026 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-69153a34-fcac-49f8-8983-72cf9f0e297c req-9144a7b4-2cf7-4457-bb1f-68f1207c6cdf service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:43.861115 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-69153a34-fcac-49f8-8983-72cf9f0e297c req-9144a7b4-2cf7-4457-bb1f-68f1207c6cdf service nova] Creating event network-changed:bcf607ac-7dab-42c6-8b61-31f31956b33b for instance 513a781e-0b66-461a-8d8a-296738d61779 on hv-cinder-84496 Aug 31 10:01:43.867044 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-69153a34-fcac-49f8-8983-72cf9f0e297c req-9144a7b4-2cf7-4457-bb1f-68f1207c6cdf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056915 Aug 31 10:01:43.867975 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 510/1035] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 10:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:01:43.874188 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-94d1389d-7ccf-406b-b4c7-2f38907d594f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Going to try to terminate instance {{(pid=127170) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 10:01:43.957980 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-94d1389d-7ccf-406b-b4c7-2f38907d594f tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "DELETE /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 204 len: 0 microversion: 2.1 time: 0.149683 Aug 31 10:01:43.962526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 526/1036] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 10:01:43 2022] DELETE /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 10:01:43.969016 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-d4ec00fb-768d-488c-8e7b-7415b5a07ff9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:43.970599 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-d4ec00fb-768d-488c-8e7b-7415b5a07ff9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:43.979649 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d4ec00fb-768d-488c-8e7b-7415b5a07ff9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:43.980342 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d4ec00fb-768d-488c-8e7b-7415b5a07ff9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:43.981148 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d4ec00fb-768d-488c-8e7b-7415b5a07ff9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:43.981898 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d4ec00fb-768d-488c-8e7b-7415b5a07ff9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:43.982355 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d4ec00fb-768d-488c-8e7b-7415b5a07ff9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:43.982777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d4ec00fb-768d-488c-8e7b-7415b5a07ff9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:44.121174 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-d4ec00fb-768d-488c-8e7b-7415b5a07ff9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:44.129350 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-d4ec00fb-768d-488c-8e7b-7415b5a07ff9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 200 len: 1575 microversion: 2.1 time: 0.165375 Aug 31 10:01:44.129965 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 511/1037] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:43 2022] GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:01:45.153043 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a19e23e2-6456-4ef7-af00-129339961610 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:45.153741 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-a19e23e2-6456-4ef7-af00-129339961610 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:45.161015 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a19e23e2-6456-4ef7-af00-129339961610 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:45.161538 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a19e23e2-6456-4ef7-af00-129339961610 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:45.161998 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a19e23e2-6456-4ef7-af00-129339961610 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:45.162705 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a19e23e2-6456-4ef7-af00-129339961610 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:45.163157 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a19e23e2-6456-4ef7-af00-129339961610 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:45.163574 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a19e23e2-6456-4ef7-af00-129339961610 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:45.346950 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-a19e23e2-6456-4ef7-af00-129339961610 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:45.354778 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a19e23e2-6456-4ef7-af00-129339961610 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 200 len: 1575 microversion: 2.1 time: 0.206082 Aug 31 10:01:45.355355 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 527/1038] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:45 2022] GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 1575 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:46.376812 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-804b0975-0f05-44d2-8dbc-866d152cc128 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:46.377602 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-804b0975-0f05-44d2-8dbc-866d152cc128 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:46.383978 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-804b0975-0f05-44d2-8dbc-866d152cc128 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:46.384445 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-804b0975-0f05-44d2-8dbc-866d152cc128 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:46.384880 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-804b0975-0f05-44d2-8dbc-866d152cc128 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:46.385613 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-804b0975-0f05-44d2-8dbc-866d152cc128 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:46.386059 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-804b0975-0f05-44d2-8dbc-866d152cc128 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:46.386474 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-804b0975-0f05-44d2-8dbc-866d152cc128 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:46.692029 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-804b0975-0f05-44d2-8dbc-866d152cc128 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:46.700001 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-804b0975-0f05-44d2-8dbc-866d152cc128 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 200 len: 1575 microversion: 2.1 time: 0.327668 Aug 31 10:01:46.700689 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 512/1039] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:46 2022] GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 1575 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:46.934531 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-4fdf3666-8e11-4510-b3c7-0fa88c7a4529 req-e11c675f-e9ab-46b4-803f-f4994153ea5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513a781e-0b66-461a-8d8a-296738d61779", "name": "network-vif-deleted", "tag": "bcf607ac-7dab-42c6-8b61-31f31956b33b"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:01:46.946337 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-4fdf3666-8e11-4510-b3c7-0fa88c7a4529 req-e11c675f-e9ab-46b4-803f-f4994153ea5d service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:46.946812 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-4fdf3666-8e11-4510-b3c7-0fa88c7a4529 req-e11c675f-e9ab-46b4-803f-f4994153ea5d service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:46.947240 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-4fdf3666-8e11-4510-b3c7-0fa88c7a4529 req-e11c675f-e9ab-46b4-803f-f4994153ea5d service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:46.958926 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-4fdf3666-8e11-4510-b3c7-0fa88c7a4529 req-e11c675f-e9ab-46b4-803f-f4994153ea5d service nova] Creating event network-vif-deleted:bcf607ac-7dab-42c6-8b61-31f31956b33b for instance 513a781e-0b66-461a-8d8a-296738d61779 on hv-cinder-84496 Aug 31 10:01:46.963856 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-4fdf3666-8e11-4510-b3c7-0fa88c7a4529 req-e11c675f-e9ab-46b4-803f-f4994153ea5d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033103 Aug 31 10:01:46.964526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 528/1040] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 10:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:01:47.722256 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c63dfd9e-f6fd-4b39-8d7a-4edd51102610 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:47.723095 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c63dfd9e-f6fd-4b39-8d7a-4edd51102610 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:47.729579 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c63dfd9e-f6fd-4b39-8d7a-4edd51102610 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:47.729894 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c63dfd9e-f6fd-4b39-8d7a-4edd51102610 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:47.730327 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c63dfd9e-f6fd-4b39-8d7a-4edd51102610 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:47.731010 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c63dfd9e-f6fd-4b39-8d7a-4edd51102610 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:47.731454 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c63dfd9e-f6fd-4b39-8d7a-4edd51102610 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:47.731867 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c63dfd9e-f6fd-4b39-8d7a-4edd51102610 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:47.764581 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c63dfd9e-f6fd-4b39-8d7a-4edd51102610 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:47.765045 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c63dfd9e-f6fd-4b39-8d7a-4edd51102610 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:47.765509 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c63dfd9e-f6fd-4b39-8d7a-4edd51102610 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:47.765946 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.objects.instance [None req-c63dfd9e-f6fd-4b39-8d7a-4edd51102610 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lazy-loading 'fault' on Instance uuid 513a781e-0b66-461a-8d8a-296738d61779 {{(pid=127171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:01:47.808252 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c63dfd9e-f6fd-4b39-8d7a-4edd51102610 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:47.817133 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c63dfd9e-f6fd-4b39-8d7a-4edd51102610 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 200 len: 1229 microversion: 2.1 time: 0.099345 Aug 31 10:01:47.817731 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 513/1041] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:47 2022] GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 1229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:48.838940 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b2538e7e-6644-4053-a5c1-84c2c168c541 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:48.839644 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b2538e7e-6644-4053-a5c1-84c2c168c541 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 513a781e-0b66-461a-8d8a-296738d61779] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:48.846037 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b2538e7e-6644-4053-a5c1-84c2c168c541 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:48.846521 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b2538e7e-6644-4053-a5c1-84c2c168c541 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:48.846955 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b2538e7e-6644-4053-a5c1-84c2c168c541 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:48.847651 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b2538e7e-6644-4053-a5c1-84c2c168c541 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:48.848100 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b2538e7e-6644-4053-a5c1-84c2c168c541 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:48.848518 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b2538e7e-6644-4053-a5c1-84c2c168c541 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:48.861892 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-b2538e7e-6644-4053-a5c1-84c2c168c541 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] HTTP exception thrown: Instance 513a781e-0b66-461a-8d8a-296738d61779 could not be found. Aug 31 10:01:48.863776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b2538e7e-6644-4053-a5c1-84c2c168c541 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Request method failure captured: Aug 31 10:01:48.863776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 HTTP/1.1 Aug 31 10:01:48.863776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 10:01:48.863776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 10:01:48.863776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 10:01:48.863776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 10:01:48.863776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 10:01:48.863776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 10:01:48.863776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 10:01:48.863776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 10:01:48.863776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy8YM8ci4vJFSG2lkdgV6Rh_nuRKXUqmeqeZAL9vYbqbNzI1QNyOdQ0H5CFETxxLVWM61BTVD241o3KesAgNLhocpiyzw017AQvOtzW_QAabNtgMEfwUu5XnGt7kiD2OZWO5bcf9w6hB6idU7QVGakMClAMCkVi56Bi857_Vz8Zs6PQ Aug 31 10:01:48.863776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 10:01:48.863776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 10:01:48.863776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 10:01:48.863776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 10:01:48.863776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 10:01:48.863776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 10:01:48.863776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: 6634173c9d534fca800d394d545a9d0c Aug 31 10:01:48.863776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-TestVolumeBootPattern-854801384 Aug 31 10:01:48.863776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 10:01:48.863776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 10:01:48.865511 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6634173c9d534fca800d394d545a9d0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6634173c9d534fca800d394d545a9d0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6634173c9d534fca800d394d545a9d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6634173c9d534fca800d394d545a9d0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 10:01:48.865511 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-TestVolumeBootPattern-854801384 Aug 31 10:01:48.865511 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: 6634173c9d534fca800d394d545a9d0c Aug 31 10:01:48.865511 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-TestVolumeBootPattern-854801384 Aug 31 10:01:48.865511 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-TestVolumeBootPattern-854801384-project Aug 31 10:01:48.865511 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 10:01:48.865511 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 10:01:48.865511 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: 1090c027746845239055973b44207556 Aug 31 10:01:48.865511 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-TestVolumeBootPattern-854801384-project Aug 31 10:01:48.865511 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 10:01:48.865511 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Instance 513a781e-0b66-461a-8d8a-296738d61779 could not be found. Aug 31 10:01:48.865511 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': '513a781e-0b66-461a-8d8a-296738d61779'} Aug 31 10:01:48.866580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:01:48.866580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:01:48.866580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:01:48.866580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:01:48.866580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:01:48.866580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:01:48.866580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:01:48.866580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:01:48.866580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:01:48.866580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:01:48.866580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 513a781e-0b66-461a-8d8a-296738d61779 could not be found. Aug 31 10:01:48.866580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:01:48.866580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:01:48.866580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:01:48.866580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:01:48.866580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:01:48.866580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:01:48.866580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:01:48.866580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:01:48.866580 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:01:48.868300 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:01:48.868300 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:01:48.868300 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:01:48.868300 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:01:48.868300 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:01:48.868300 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:01:48.868300 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:01:48.868300 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 513a781e-0b66-461a-8d8a-296738d61779 could not be found. Aug 31 10:01:48.868300 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:01:48.868300 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:01:48.868300 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:01:48.868300 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:01:48.868300 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:01:48.868300 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:01:48.868300 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:01:48.868300 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:01:48.868300 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 513a781e-0b66-461a-8d8a-296738d61779 could not be found. Aug 31 10:01:48.868300 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:01:48.869704 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b2538e7e-6644-4053-a5c1-84c2c168c541 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Returning 404 to user: Instance 513a781e-0b66-461a-8d8a-296738d61779 could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:01:48.869704 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b2538e7e-6644-4053-a5c1-84c2c168c541 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779" status: 404 len: 111 microversion: 2.1 time: 0.030916 Aug 31 10:01:48.869704 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 529/1042] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:48 2022] GET /compute/v2.1/servers/513a781e-0b66-461a-8d8a-296738d61779 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:01:51.942396 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-54ac24dd-7c86-42b2-ac4e-e229e2ecf683 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:51.942396 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-54ac24dd-7c86-42b2-ac4e-e229e2ecf683 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:51.943675 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-0e4d48a9-6391-41ab-b438-cba2c6dec609 req-f57ee50d-2494-400f-93a6-18c3d44fae7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "482325e0-2a4b-4446-804a-0e3a1bcb722c", "tag": "6937ee29-5c42-40ef-97b4-9409defc0131"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:01:51.949200 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-54ac24dd-7c86-42b2-ac4e-e229e2ecf683 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:51.949794 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-54ac24dd-7c86-42b2-ac4e-e229e2ecf683 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:51.950299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-54ac24dd-7c86-42b2-ac4e-e229e2ecf683 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:51.951249 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-54ac24dd-7c86-42b2-ac4e-e229e2ecf683 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:51.951777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-54ac24dd-7c86-42b2-ac4e-e229e2ecf683 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:51.952273 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-54ac24dd-7c86-42b2-ac4e-e229e2ecf683 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:51.954947 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-0e4d48a9-6391-41ab-b438-cba2c6dec609 req-f57ee50d-2494-400f-93a6-18c3d44fae7c service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:51.955532 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-0e4d48a9-6391-41ab-b438-cba2c6dec609 req-f57ee50d-2494-400f-93a6-18c3d44fae7c service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:51.956060 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-0e4d48a9-6391-41ab-b438-cba2c6dec609 req-f57ee50d-2494-400f-93a6-18c3d44fae7c service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:51.967793 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-0e4d48a9-6391-41ab-b438-cba2c6dec609 req-f57ee50d-2494-400f-93a6-18c3d44fae7c service nova] Creating event network-changed:6937ee29-5c42-40ef-97b4-9409defc0131 for instance 482325e0-2a4b-4446-804a-0e3a1bcb722c on hv-cinder-84496 Aug 31 10:01:51.973839 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-0e4d48a9-6391-41ab-b438-cba2c6dec609 req-f57ee50d-2494-400f-93a6-18c3d44fae7c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033796 Aug 31 10:01:51.975159 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 530/1043] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 10:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:01:51.988249 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-54ac24dd-7c86-42b2-ac4e-e229e2ecf683 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Going to try to terminate instance {{(pid=127171) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 10:01:52.084583 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-54ac24dd-7c86-42b2-ac4e-e229e2ecf683 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "DELETE /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 204 len: 0 microversion: 2.1 time: 0.146679 Aug 31 10:01:52.090031 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 514/1044] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 10:01:51 2022] DELETE /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 10:01:52.103007 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b7b90cad-9bdc-4dca-ac9a-13ae82c53d53 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:52.104326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b7b90cad-9bdc-4dca-ac9a-13ae82c53d53 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:52.117634 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b7b90cad-9bdc-4dca-ac9a-13ae82c53d53 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:52.118492 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b7b90cad-9bdc-4dca-ac9a-13ae82c53d53 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:52.119234 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b7b90cad-9bdc-4dca-ac9a-13ae82c53d53 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:52.120408 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b7b90cad-9bdc-4dca-ac9a-13ae82c53d53 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:52.121202 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b7b90cad-9bdc-4dca-ac9a-13ae82c53d53 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:52.122019 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b7b90cad-9bdc-4dca-ac9a-13ae82c53d53 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:52.379167 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b7b90cad-9bdc-4dca-ac9a-13ae82c53d53 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:52.387435 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b7b90cad-9bdc-4dca-ac9a-13ae82c53d53 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1575 microversion: 2.1 time: 0.293570 Aug 31 10:01:52.394205 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 531/1045] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:52 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1575 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:53.410159 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-be9664ea-6626-437b-a3d7-fc1e10a055a9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:53.410857 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-be9664ea-6626-437b-a3d7-fc1e10a055a9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:53.417086 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be9664ea-6626-437b-a3d7-fc1e10a055a9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:53.417604 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be9664ea-6626-437b-a3d7-fc1e10a055a9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:53.418033 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be9664ea-6626-437b-a3d7-fc1e10a055a9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:53.418739 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be9664ea-6626-437b-a3d7-fc1e10a055a9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:53.419167 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be9664ea-6626-437b-a3d7-fc1e10a055a9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:53.419589 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-be9664ea-6626-437b-a3d7-fc1e10a055a9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:53.509667 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-be9664ea-6626-437b-a3d7-fc1e10a055a9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1090c027746845239055973b44207556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6634173c9d534fca800d394d545a9d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:01:53.518326 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-be9664ea-6626-437b-a3d7-fc1e10a055a9 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 200 len: 1389 microversion: 2.1 time: 0.113140 Aug 31 10:01:53.518951 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 515/1046] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:53 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 1389 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:01:53.989363 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-d99e4fed-326f-4ce7-9d02-f10bb9a6299d req-70002a4a-6b67-441f-b156-75fa5d426df9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "482325e0-2a4b-4446-804a-0e3a1bcb722c", "name": "network-vif-deleted", "tag": "6937ee29-5c42-40ef-97b4-9409defc0131"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:01:53.999358 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-d99e4fed-326f-4ce7-9d02-f10bb9a6299d req-70002a4a-6b67-441f-b156-75fa5d426df9 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:53.999907 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-d99e4fed-326f-4ce7-9d02-f10bb9a6299d req-70002a4a-6b67-441f-b156-75fa5d426df9 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:54.000326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-d99e4fed-326f-4ce7-9d02-f10bb9a6299d req-70002a4a-6b67-441f-b156-75fa5d426df9 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:54.011588 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-d99e4fed-326f-4ce7-9d02-f10bb9a6299d req-70002a4a-6b67-441f-b156-75fa5d426df9 service nova] Creating event network-vif-deleted:6937ee29-5c42-40ef-97b4-9409defc0131 for instance 482325e0-2a4b-4446-804a-0e3a1bcb722c on hv-cinder-84496 Aug 31 10:01:54.017344 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-d99e4fed-326f-4ce7-9d02-f10bb9a6299d req-70002a4a-6b67-441f-b156-75fa5d426df9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031985 Aug 31 10:01:54.017921 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 532/1047] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 10:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:01:54.540232 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-08a8ee99-e5fb-4cdb-8b4a-3918ca82fcb1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:54.540840 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-08a8ee99-e5fb-4cdb-8b4a-3918ca82fcb1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: 482325e0-2a4b-4446-804a-0e3a1bcb722c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:54.548385 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-08a8ee99-e5fb-4cdb-8b4a-3918ca82fcb1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:54.548799 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-08a8ee99-e5fb-4cdb-8b4a-3918ca82fcb1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:54.549233 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-08a8ee99-e5fb-4cdb-8b4a-3918ca82fcb1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:54.549952 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-08a8ee99-e5fb-4cdb-8b4a-3918ca82fcb1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:54.550433 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-08a8ee99-e5fb-4cdb-8b4a-3918ca82fcb1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:54.550860 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-08a8ee99-e5fb-4cdb-8b4a-3918ca82fcb1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:54.564384 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.wsgi [None req-08a8ee99-e5fb-4cdb-8b4a-3918ca82fcb1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] HTTP exception thrown: Instance 482325e0-2a4b-4446-804a-0e3a1bcb722c could not be found. Aug 31 10:01:54.566078 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-08a8ee99-e5fb-4cdb-8b4a-3918ca82fcb1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Request method failure captured: Aug 31 10:01:54.566078 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: request: GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c HTTP/1.1 Aug 31 10:01:54.566078 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept: application/json Aug 31 10:01:54.566078 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept-Encoding: identity Aug 31 10:01:54.566078 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Connection: close Aug 31 10:01:54.566078 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Length: 0 Aug 31 10:01:54.566078 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Type: application/json Aug 31 10:01:54.566078 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Host: 10.222.0.13 Aug 31 10:01:54.566078 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Openstack-System-Scope: None Aug 31 10:01:54.566078 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: User-Agent: python-urllib3/1.26.12 Aug 31 10:01:54.566078 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Auth-Token: gAAAAABjDy8YM8ci4vJFSG2lkdgV6Rh_nuRKXUqmeqeZAL9vYbqbNzI1QNyOdQ0H5CFETxxLVWM61BTVD241o3KesAgNLhocpiyzw017AQvOtzW_QAabNtgMEfwUu5XnGt7kiD2OZWO5bcf9w6hB6idU7QVGakMClAMCkVi56Bi857_Vz8Zs6PQ Aug 31 10:01:54.566078 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Id: None Aug 31 10:01:54.566078 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Name: None Aug 31 10:01:54.566078 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Identity-Status: Confirmed Aug 31 10:01:54.566078 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Is-Admin-Project: True Aug 31 10:01:54.566078 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Id: default Aug 31 10:01:54.566078 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Name: Default Aug 31 10:01:54.566078 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Id: 6634173c9d534fca800d394d545a9d0c Aug 31 10:01:54.566078 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Name: tempest-TestVolumeBootPattern-854801384 Aug 31 10:01:54.566078 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Role: member,reader Aug 31 10:01:54.566078 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Roles: member,reader Aug 31 10:01:54.567882 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6634173c9d534fca800d394d545a9d0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6634173c9d534fca800d394d545a9d0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6634173c9d534fca800d394d545a9d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6634173c9d534fca800d394d545a9d0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 10:01:54.567882 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant: tempest-TestVolumeBootPattern-854801384 Aug 31 10:01:54.567882 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Id: 6634173c9d534fca800d394d545a9d0c Aug 31 10:01:54.567882 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Name: tempest-TestVolumeBootPattern-854801384 Aug 31 10:01:54.567882 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User: tempest-TestVolumeBootPattern-854801384-project Aug 31 10:01:54.567882 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Id: default Aug 31 10:01:54.567882 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Name: Default Aug 31 10:01:54.567882 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Id: 1090c027746845239055973b44207556 Aug 31 10:01:54.567882 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Name: tempest-TestVolumeBootPattern-854801384-project Aug 31 10:01:54.567882 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: method: > Aug 31 10:01:54.567882 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: exception: Instance 482325e0-2a4b-4446-804a-0e3a1bcb722c could not be found. Aug 31 10:01:54.567882 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: action_args: {'id': '482325e0-2a4b-4446-804a-0e3a1bcb722c'} Aug 31 10:01:54.569027 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:01:54.569027 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:01:54.569027 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:01:54.569027 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:01:54.569027 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:01:54.569027 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:01:54.569027 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:01:54.569027 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:01:54.569027 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:01:54.569027 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:01:54.569027 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 482325e0-2a4b-4446-804a-0e3a1bcb722c could not be found. Aug 31 10:01:54.569027 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 10:01:54.569027 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:01:54.569027 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 10:01:54.569027 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:01:54.569027 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:01:54.569027 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:01:54.569027 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:01:54.569027 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:01:54.569027 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:01:54.570585 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:01:54.570585 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:01:54.570585 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:01:54.570585 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:01:54.570585 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:01:54.570585 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:01:54.570585 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:01:54.570585 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 482325e0-2a4b-4446-804a-0e3a1bcb722c could not be found. Aug 31 10:01:54.570585 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 10:01:54.570585 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:01:54.570585 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 10:01:54.570585 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:01:54.570585 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:01:54.570585 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:01:54.570585 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:01:54.570585 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:01:54.570585 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 482325e0-2a4b-4446-804a-0e3a1bcb722c could not be found. Aug 31 10:01:54.570585 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 10:01:54.572064 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-08a8ee99-e5fb-4cdb-8b4a-3918ca82fcb1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Returning 404 to user: Instance 482325e0-2a4b-4446-804a-0e3a1bcb722c could not be found. {{(pid=127171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:01:54.572064 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-08a8ee99-e5fb-4cdb-8b4a-3918ca82fcb1 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c" status: 404 len: 111 microversion: 2.1 time: 0.031140 Aug 31 10:01:54.572064 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 516/1048] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:54 2022] GET /compute/v2.1/servers/482325e0-2a4b-4446-804a-0e3a1bcb722c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:01:55.013530 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-8822aa4d-1ccd-4cba-8a32-49a0ac4e6442 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:55.014286 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-8822aa4d-1ccd-4cba-8a32-49a0ac4e6442 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:55.020902 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8822aa4d-1ccd-4cba-8a32-49a0ac4e6442 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:55.021406 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8822aa4d-1ccd-4cba-8a32-49a0ac4e6442 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:55.021844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8822aa4d-1ccd-4cba-8a32-49a0ac4e6442 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:55.022568 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8822aa4d-1ccd-4cba-8a32-49a0ac4e6442 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:55.023083 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8822aa4d-1ccd-4cba-8a32-49a0ac4e6442 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:55.023791 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8822aa4d-1ccd-4cba-8a32-49a0ac4e6442 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:55.039308 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-8822aa4d-1ccd-4cba-8a32-49a0ac4e6442 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] HTTP exception thrown: Instance eeb177fd-40cd-4551-be64-eac4c6283268 could not be found. Aug 31 10:01:55.040964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-8822aa4d-1ccd-4cba-8a32-49a0ac4e6442 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Request method failure captured: Aug 31 10:01:55.040964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: DELETE /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 HTTP/1.1 Aug 31 10:01:55.040964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 10:01:55.040964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 10:01:55.040964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 10:01:55.040964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 10:01:55.040964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 10:01:55.040964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 10:01:55.040964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 10:01:55.040964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 10:01:55.040964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDy8YM8ci4vJFSG2lkdgV6Rh_nuRKXUqmeqeZAL9vYbqbNzI1QNyOdQ0H5CFETxxLVWM61BTVD241o3KesAgNLhocpiyzw017AQvOtzW_QAabNtgMEfwUu5XnGt7kiD2OZWO5bcf9w6hB6idU7QVGakMClAMCkVi56Bi857_Vz8Zs6PQ Aug 31 10:01:55.040964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 10:01:55.040964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 10:01:55.040964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 10:01:55.040964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 10:01:55.040964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 10:01:55.040964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 10:01:55.040964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: 6634173c9d534fca800d394d545a9d0c Aug 31 10:01:55.040964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-TestVolumeBootPattern-854801384 Aug 31 10:01:55.040964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 10:01:55.040964 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 10:01:55.042592 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6634173c9d534fca800d394d545a9d0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6634173c9d534fca800d394d545a9d0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6634173c9d534fca800d394d545a9d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6634173c9d534fca800d394d545a9d0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 10:01:55.042592 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-TestVolumeBootPattern-854801384 Aug 31 10:01:55.042592 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: 6634173c9d534fca800d394d545a9d0c Aug 31 10:01:55.042592 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-TestVolumeBootPattern-854801384 Aug 31 10:01:55.042592 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-TestVolumeBootPattern-854801384-project Aug 31 10:01:55.042592 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 10:01:55.042592 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 10:01:55.042592 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: 1090c027746845239055973b44207556 Aug 31 10:01:55.042592 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-TestVolumeBootPattern-854801384-project Aug 31 10:01:55.042592 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 10:01:55.042592 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Instance eeb177fd-40cd-4551-be64-eac4c6283268 could not be found. Aug 31 10:01:55.042592 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': 'eeb177fd-40cd-4551-be64-eac4c6283268'} Aug 31 10:01:55.043436 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:01:55.043436 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:01:55.043436 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:01:55.043436 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:01:55.043436 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:01:55.043436 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:01:55.043436 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:01:55.043436 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:01:55.043436 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:01:55.043436 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:01:55.043436 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeb177fd-40cd-4551-be64-eac4c6283268 could not be found. Aug 31 10:01:55.043436 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:01:55.043436 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:01:55.043436 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:01:55.043436 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:01:55.043436 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:01:55.043436 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:01:55.043436 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:01:55.043436 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:01:55.043436 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:01:55.044746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:01:55.044746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 10:01:55.044746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 10:01:55.044746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 10:01:55.044746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 10:01:55.044746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:01:55.044746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:01:55.044746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:01:55.044746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:01:55.044746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeb177fd-40cd-4551-be64-eac4c6283268 could not be found. Aug 31 10:01:55.044746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:01:55.044746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:01:55.044746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:01:55.044746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:01:55.044746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:01:55.044746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:01:55.044746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:01:55.044746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:01:55.044746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeb177fd-40cd-4551-be64-eac4c6283268 could not be found. Aug 31 10:01:55.044746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:01:55.046272 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-8822aa4d-1ccd-4cba-8a32-49a0ac4e6442 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Returning 404 to user: Instance eeb177fd-40cd-4551-be64-eac4c6283268 could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:01:55.046272 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-8822aa4d-1ccd-4cba-8a32-49a0ac4e6442 tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "DELETE /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 404 len: 111 microversion: 2.1 time: 0.033695 Aug 31 10:01:55.046272 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 533/1049] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 10:01:55 2022] DELETE /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:01:55.051295 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-a0108141-6214-4f95-8819-e926dccbecfd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:55.051814 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-a0108141-6214-4f95-8819-e926dccbecfd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] [instance: eeb177fd-40cd-4551-be64-eac4c6283268] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:01:55.057829 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a0108141-6214-4f95-8819-e926dccbecfd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:55.058316 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a0108141-6214-4f95-8819-e926dccbecfd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:55.058744 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a0108141-6214-4f95-8819-e926dccbecfd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:55.059437 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a0108141-6214-4f95-8819-e926dccbecfd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:01:55.059888 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a0108141-6214-4f95-8819-e926dccbecfd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:01:55.060312 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a0108141-6214-4f95-8819-e926dccbecfd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:01:55.074044 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.wsgi [None req-a0108141-6214-4f95-8819-e926dccbecfd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] HTTP exception thrown: Instance eeb177fd-40cd-4551-be64-eac4c6283268 could not be found. Aug 31 10:01:55.075582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-a0108141-6214-4f95-8819-e926dccbecfd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Request method failure captured: Aug 31 10:01:55.075582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: request: GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 HTTP/1.1 Aug 31 10:01:55.075582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept: application/json Aug 31 10:01:55.075582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept-Encoding: identity Aug 31 10:01:55.075582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Connection: close Aug 31 10:01:55.075582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Length: 0 Aug 31 10:01:55.075582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Type: application/json Aug 31 10:01:55.075582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Host: 10.222.0.13 Aug 31 10:01:55.075582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Openstack-System-Scope: None Aug 31 10:01:55.075582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: User-Agent: python-urllib3/1.26.12 Aug 31 10:01:55.075582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Auth-Token: gAAAAABjDy8YM8ci4vJFSG2lkdgV6Rh_nuRKXUqmeqeZAL9vYbqbNzI1QNyOdQ0H5CFETxxLVWM61BTVD241o3KesAgNLhocpiyzw017AQvOtzW_QAabNtgMEfwUu5XnGt7kiD2OZWO5bcf9w6hB6idU7QVGakMClAMCkVi56Bi857_Vz8Zs6PQ Aug 31 10:01:55.075582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Id: None Aug 31 10:01:55.075582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Name: None Aug 31 10:01:55.075582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Identity-Status: Confirmed Aug 31 10:01:55.075582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Is-Admin-Project: True Aug 31 10:01:55.075582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Id: default Aug 31 10:01:55.075582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Name: Default Aug 31 10:01:55.075582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Id: 6634173c9d534fca800d394d545a9d0c Aug 31 10:01:55.075582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Name: tempest-TestVolumeBootPattern-854801384 Aug 31 10:01:55.075582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Role: member,reader Aug 31 10:01:55.075582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Roles: member,reader Aug 31 10:01:55.077770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6634173c9d534fca800d394d545a9d0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6634173c9d534fca800d394d545a9d0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6634173c9d534fca800d394d545a9d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6634173c9d534fca800d394d545a9d0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 10:01:55.077770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant: tempest-TestVolumeBootPattern-854801384 Aug 31 10:01:55.077770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Id: 6634173c9d534fca800d394d545a9d0c Aug 31 10:01:55.077770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Name: tempest-TestVolumeBootPattern-854801384 Aug 31 10:01:55.077770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User: tempest-TestVolumeBootPattern-854801384-project Aug 31 10:01:55.077770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Id: default Aug 31 10:01:55.077770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Name: Default Aug 31 10:01:55.077770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Id: 1090c027746845239055973b44207556 Aug 31 10:01:55.077770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Name: tempest-TestVolumeBootPattern-854801384-project Aug 31 10:01:55.077770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: method: > Aug 31 10:01:55.077770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: exception: Instance eeb177fd-40cd-4551-be64-eac4c6283268 could not be found. Aug 31 10:01:55.077770 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: action_args: {'id': 'eeb177fd-40cd-4551-be64-eac4c6283268'} Aug 31 10:01:55.079285 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:01:55.079285 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:01:55.079285 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:01:55.079285 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:01:55.079285 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:01:55.079285 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:01:55.079285 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:01:55.079285 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:01:55.079285 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:01:55.079285 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:01:55.079285 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeb177fd-40cd-4551-be64-eac4c6283268 could not be found. Aug 31 10:01:55.079285 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 10:01:55.079285 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:01:55.079285 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 10:01:55.079285 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:01:55.079285 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:01:55.079285 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:01:55.079285 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:01:55.079285 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:01:55.079285 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:01:55.080777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:01:55.080777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:01:55.080777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:01:55.080777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:01:55.080777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:01:55.080777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:01:55.080777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:01:55.080777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeb177fd-40cd-4551-be64-eac4c6283268 could not be found. Aug 31 10:01:55.080777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 10:01:55.080777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:01:55.080777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 10:01:55.080777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:01:55.080777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:01:55.080777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:01:55.080777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:01:55.080777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:01:55.080777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeb177fd-40cd-4551-be64-eac4c6283268 could not be found. Aug 31 10:01:55.080777 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 10:01:55.082217 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-a0108141-6214-4f95-8819-e926dccbecfd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Returning 404 to user: Instance eeb177fd-40cd-4551-be64-eac4c6283268 could not be found. {{(pid=127171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:01:55.082217 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-a0108141-6214-4f95-8819-e926dccbecfd tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268" status: 404 len: 111 microversion: 2.1 time: 0.029704 Aug 31 10:01:55.082217 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 517/1050] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:01:55 2022] GET /compute/v2.1/servers/eeb177fd-40cd-4551-be64-eac4c6283268 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:01:56.371318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-abb11b2a-d6b8-4fdd-9322-dbdfec78c8cb tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] Calling method '.version_select at 0x7f550b725a60>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:01:56.391602 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-abb11b2a-d6b8-4fdd-9322-dbdfec78c8cb tempest-TestVolumeBootPattern-854801384 tempest-TestVolumeBootPattern-854801384-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-235501854" status: 202 len: 0 microversion: 2.1 time: 0.024061 Aug 31 10:01:56.392183 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 534/1051] 10.222.0.13 () {58 vars in 1260 bytes} [Wed Aug 31 10:01:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-235501854 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:02:13.161375 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:02:13.162152 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:02:13.401071 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-90231538-84a4-4ee0-b7a1-f7410706c16b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:13.401621 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-90231538-84a4-4ee0-b7a1-f7410706c16b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:13.407991 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-90231538-84a4-4ee0-b7a1-f7410706c16b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:13.408473 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-90231538-84a4-4ee0-b7a1-f7410706c16b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:13.408908 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-90231538-84a4-4ee0-b7a1-f7410706c16b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:13.409652 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-90231538-84a4-4ee0-b7a1-f7410706c16b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:13.410105 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-90231538-84a4-4ee0-b7a1-f7410706c16b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:13.410528 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-90231538-84a4-4ee0-b7a1-f7410706c16b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:13.433747 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-90231538-84a4-4ee0-b7a1-f7410706c16b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c/ips" status: 200 len: 152 microversion: 2.20 time: 0.278945 Aug 31 10:02:13.434292 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 518/1052] 10.222.0.13 () {60 vars in 1289 bytes} [Wed Aug 31 10:02:13 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c/ips => generated 152 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:02:15.264157 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:02:15.264815 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:02:15.269341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-2d63fe48-7247-4486-8465-40dabf52ee29 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:02:15.269889 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-2d63fe48-7247-4486-8465-40dabf52ee29 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:15.278142 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2d63fe48-7247-4486-8465-40dabf52ee29 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:15.278700 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2d63fe48-7247-4486-8465-40dabf52ee29 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:15.279187 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2d63fe48-7247-4486-8465-40dabf52ee29 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:15.279906 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2d63fe48-7247-4486-8465-40dabf52ee29 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:15.280347 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2d63fe48-7247-4486-8465-40dabf52ee29 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:15.280758 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2d63fe48-7247-4486-8465-40dabf52ee29 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:15.306960 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.objects.instance [None req-2d63fe48-7247-4486-8465-40dabf52ee29 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lazy-loading 'flavor' on Instance uuid f34e6a94-72da-4a22-bab7-c5edbaae687c {{(pid=127170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:02:15.511247 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-2d63fe48-7247-4486-8465-40dabf52ee29 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "POST /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c/action" status: 202 len: 0 microversion: 2.20 time: 0.248684 Aug 31 10:02:15.511847 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 535/1053] 10.222.0.13 () {62 vars in 1319 bytes} [Wed Aug 31 10:02:15 2022] POST /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 10:02:15.521964 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c94a0171-2819-47ab-be27-3a4f0f204f8f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:15.522696 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c94a0171-2819-47ab-be27-3a4f0f204f8f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:15.530114 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c94a0171-2819-47ab-be27-3a4f0f204f8f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:15.530756 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c94a0171-2819-47ab-be27-3a4f0f204f8f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:15.531268 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c94a0171-2819-47ab-be27-3a4f0f204f8f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:15.532050 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c94a0171-2819-47ab-be27-3a4f0f204f8f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:15.533085 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c94a0171-2819-47ab-be27-3a4f0f204f8f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:15.533707 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c94a0171-2819-47ab-be27-3a4f0f204f8f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:15.694148 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c94a0171-2819-47ab-be27-3a4f0f204f8f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:15.702709 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c94a0171-2819-47ab-be27-3a4f0f204f8f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:15.704690 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c94a0171-2819-47ab-be27-3a4f0f204f8f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:15.705951 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c94a0171-2819-47ab-be27-3a4f0f204f8f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1724 microversion: 2.20 time: 0.188593 Aug 31 10:02:15.706516 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 519/1054] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:15 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:16.731086 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-4c9973ae-5381-4f5f-b9e2-852dfe86857e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:16.731813 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-4c9973ae-5381-4f5f-b9e2-852dfe86857e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:16.740119 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4c9973ae-5381-4f5f-b9e2-852dfe86857e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:16.740601 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4c9973ae-5381-4f5f-b9e2-852dfe86857e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:16.741032 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4c9973ae-5381-4f5f-b9e2-852dfe86857e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:16.741754 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4c9973ae-5381-4f5f-b9e2-852dfe86857e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:16.742203 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4c9973ae-5381-4f5f-b9e2-852dfe86857e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:16.742619 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4c9973ae-5381-4f5f-b9e2-852dfe86857e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:16.888795 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-4c9973ae-5381-4f5f-b9e2-852dfe86857e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:16.897931 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-4c9973ae-5381-4f5f-b9e2-852dfe86857e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:16.899458 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-4c9973ae-5381-4f5f-b9e2-852dfe86857e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:16.900810 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-4c9973ae-5381-4f5f-b9e2-852dfe86857e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1724 microversion: 2.20 time: 0.174499 Aug 31 10:02:16.901468 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 536/1055] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:16 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:17.925190 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-7b5cda10-727c-4fcc-bd59-888fdb722595 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:17.925875 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-7b5cda10-727c-4fcc-bd59-888fdb722595 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:17.932715 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7b5cda10-727c-4fcc-bd59-888fdb722595 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:17.933208 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7b5cda10-727c-4fcc-bd59-888fdb722595 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:17.933685 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7b5cda10-727c-4fcc-bd59-888fdb722595 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:17.934403 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7b5cda10-727c-4fcc-bd59-888fdb722595 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:17.934885 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7b5cda10-727c-4fcc-bd59-888fdb722595 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:17.935324 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7b5cda10-727c-4fcc-bd59-888fdb722595 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:18.076148 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7b5cda10-727c-4fcc-bd59-888fdb722595 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:18.085162 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7b5cda10-727c-4fcc-bd59-888fdb722595 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:18.086613 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7b5cda10-727c-4fcc-bd59-888fdb722595 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:18.087775 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-7b5cda10-727c-4fcc-bd59-888fdb722595 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1724 microversion: 2.20 time: 0.166685 Aug 31 10:02:18.088329 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 520/1056] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:17 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:19.111761 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-56e160d4-d7ac-4141-89db-c7791767558e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:19.112385 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-56e160d4-d7ac-4141-89db-c7791767558e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:19.119153 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-56e160d4-d7ac-4141-89db-c7791767558e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:19.119631 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-56e160d4-d7ac-4141-89db-c7791767558e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:19.120061 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-56e160d4-d7ac-4141-89db-c7791767558e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:19.120759 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-56e160d4-d7ac-4141-89db-c7791767558e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:19.121205 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-56e160d4-d7ac-4141-89db-c7791767558e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:19.121656 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-56e160d4-d7ac-4141-89db-c7791767558e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:19.265325 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-56e160d4-d7ac-4141-89db-c7791767558e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:19.274341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-56e160d4-d7ac-4141-89db-c7791767558e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:19.275776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-56e160d4-d7ac-4141-89db-c7791767558e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:19.276932 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-56e160d4-d7ac-4141-89db-c7791767558e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1724 microversion: 2.20 time: 0.169838 Aug 31 10:02:19.277510 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 537/1057] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:19 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:20.299912 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-caebbbff-741b-4562-a5fe-d2ce101ee307 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:20.300488 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-caebbbff-741b-4562-a5fe-d2ce101ee307 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:20.306985 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-caebbbff-741b-4562-a5fe-d2ce101ee307 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:20.307462 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-caebbbff-741b-4562-a5fe-d2ce101ee307 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:20.307888 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-caebbbff-741b-4562-a5fe-d2ce101ee307 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:20.308588 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-caebbbff-741b-4562-a5fe-d2ce101ee307 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:20.309034 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-caebbbff-741b-4562-a5fe-d2ce101ee307 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:20.309486 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-caebbbff-741b-4562-a5fe-d2ce101ee307 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:20.447765 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-caebbbff-741b-4562-a5fe-d2ce101ee307 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:20.457015 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-caebbbff-741b-4562-a5fe-d2ce101ee307 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:20.458491 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-caebbbff-741b-4562-a5fe-d2ce101ee307 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:20.459671 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-caebbbff-741b-4562-a5fe-d2ce101ee307 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1724 microversion: 2.20 time: 0.164107 Aug 31 10:02:20.460238 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 521/1058] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:20 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:21.483285 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-874667fd-9327-4c63-b6e4-8128dd237ec2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:21.483904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-874667fd-9327-4c63-b6e4-8128dd237ec2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:21.491713 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-874667fd-9327-4c63-b6e4-8128dd237ec2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:21.492199 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-874667fd-9327-4c63-b6e4-8128dd237ec2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:21.492717 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-874667fd-9327-4c63-b6e4-8128dd237ec2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:21.493436 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-874667fd-9327-4c63-b6e4-8128dd237ec2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:21.493894 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-874667fd-9327-4c63-b6e4-8128dd237ec2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:21.494316 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-874667fd-9327-4c63-b6e4-8128dd237ec2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:21.630260 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-874667fd-9327-4c63-b6e4-8128dd237ec2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:21.638522 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-874667fd-9327-4c63-b6e4-8128dd237ec2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:21.639959 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-874667fd-9327-4c63-b6e4-8128dd237ec2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:21.641135 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-874667fd-9327-4c63-b6e4-8128dd237ec2 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1724 microversion: 2.20 time: 0.161806 Aug 31 10:02:21.642421 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 538/1059] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:21 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:22.664607 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-1115875b-717b-4e36-8a27-e2fc70e94f53 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:22.665224 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-1115875b-717b-4e36-8a27-e2fc70e94f53 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:22.671888 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1115875b-717b-4e36-8a27-e2fc70e94f53 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:22.672362 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1115875b-717b-4e36-8a27-e2fc70e94f53 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:22.673293 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1115875b-717b-4e36-8a27-e2fc70e94f53 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:22.674008 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1115875b-717b-4e36-8a27-e2fc70e94f53 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:22.674488 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1115875b-717b-4e36-8a27-e2fc70e94f53 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:22.674871 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-1115875b-717b-4e36-8a27-e2fc70e94f53 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:22.809812 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-1115875b-717b-4e36-8a27-e2fc70e94f53 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:22.820108 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-1115875b-717b-4e36-8a27-e2fc70e94f53 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:22.821580 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-1115875b-717b-4e36-8a27-e2fc70e94f53 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:22.822747 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-1115875b-717b-4e36-8a27-e2fc70e94f53 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1724 microversion: 2.20 time: 0.162108 Aug 31 10:02:22.823298 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 522/1060] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:22 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:23.845526 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f4057988-7874-44ec-b2a0-ea278d7161f3 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:23.846164 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-f4057988-7874-44ec-b2a0-ea278d7161f3 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:23.852698 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f4057988-7874-44ec-b2a0-ea278d7161f3 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:23.853178 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f4057988-7874-44ec-b2a0-ea278d7161f3 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:23.853641 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f4057988-7874-44ec-b2a0-ea278d7161f3 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:23.854331 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f4057988-7874-44ec-b2a0-ea278d7161f3 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:23.854770 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f4057988-7874-44ec-b2a0-ea278d7161f3 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:23.855190 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f4057988-7874-44ec-b2a0-ea278d7161f3 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:23.989228 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-f4057988-7874-44ec-b2a0-ea278d7161f3 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:23.997373 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-f4057988-7874-44ec-b2a0-ea278d7161f3 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:23.998845 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-f4057988-7874-44ec-b2a0-ea278d7161f3 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:24.000007 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-f4057988-7874-44ec-b2a0-ea278d7161f3 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1724 microversion: 2.20 time: 0.158800 Aug 31 10:02:24.000563 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 539/1061] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:23 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:25.024196 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-b0dd1fd7-84e6-4cd8-92a6-ec973e0b18bc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:25.024704 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-b0dd1fd7-84e6-4cd8-92a6-ec973e0b18bc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:25.031037 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b0dd1fd7-84e6-4cd8-92a6-ec973e0b18bc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:25.031515 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b0dd1fd7-84e6-4cd8-92a6-ec973e0b18bc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:25.031986 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b0dd1fd7-84e6-4cd8-92a6-ec973e0b18bc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:25.032706 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b0dd1fd7-84e6-4cd8-92a6-ec973e0b18bc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:25.033211 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b0dd1fd7-84e6-4cd8-92a6-ec973e0b18bc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:25.033679 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-b0dd1fd7-84e6-4cd8-92a6-ec973e0b18bc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:25.167411 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b0dd1fd7-84e6-4cd8-92a6-ec973e0b18bc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:25.176572 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b0dd1fd7-84e6-4cd8-92a6-ec973e0b18bc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:25.178186 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-b0dd1fd7-84e6-4cd8-92a6-ec973e0b18bc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:25.179347 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-b0dd1fd7-84e6-4cd8-92a6-ec973e0b18bc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1724 microversion: 2.20 time: 0.159333 Aug 31 10:02:25.179897 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 523/1062] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:25 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:26.203072 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-fd3b71bc-37d8-4540-9b25-0d30492f4ff4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:26.203676 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-fd3b71bc-37d8-4540-9b25-0d30492f4ff4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:26.211366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fd3b71bc-37d8-4540-9b25-0d30492f4ff4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:26.211845 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fd3b71bc-37d8-4540-9b25-0d30492f4ff4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:26.212275 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fd3b71bc-37d8-4540-9b25-0d30492f4ff4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:26.212963 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fd3b71bc-37d8-4540-9b25-0d30492f4ff4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:26.213427 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fd3b71bc-37d8-4540-9b25-0d30492f4ff4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:26.213847 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fd3b71bc-37d8-4540-9b25-0d30492f4ff4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:26.342934 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-fd3b71bc-37d8-4540-9b25-0d30492f4ff4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:26.351573 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-fd3b71bc-37d8-4540-9b25-0d30492f4ff4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:26.353005 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-fd3b71bc-37d8-4540-9b25-0d30492f4ff4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:26.354194 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-fd3b71bc-37d8-4540-9b25-0d30492f4ff4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1724 microversion: 2.20 time: 0.155097 Aug 31 10:02:26.354745 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 540/1063] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:26 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:27.377938 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-15839480-f811-42e1-8a40-66b0a26818cb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:27.378585 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-15839480-f811-42e1-8a40-66b0a26818cb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:27.384423 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-15839480-f811-42e1-8a40-66b0a26818cb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:27.384900 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-15839480-f811-42e1-8a40-66b0a26818cb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:27.385328 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-15839480-f811-42e1-8a40-66b0a26818cb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:27.386035 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-15839480-f811-42e1-8a40-66b0a26818cb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:27.386478 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-15839480-f811-42e1-8a40-66b0a26818cb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:27.386893 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-15839480-f811-42e1-8a40-66b0a26818cb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:27.521667 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-15839480-f811-42e1-8a40-66b0a26818cb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:27.529725 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-15839480-f811-42e1-8a40-66b0a26818cb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:27.531167 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-15839480-f811-42e1-8a40-66b0a26818cb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:27.532332 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-15839480-f811-42e1-8a40-66b0a26818cb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1745 microversion: 2.20 time: 0.159150 Aug 31 10:02:27.532883 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 524/1064] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:27 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:28.556037 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-9ad25bab-fc2c-49c5-9066-290d10b663b8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:28.556671 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-9ad25bab-fc2c-49c5-9066-290d10b663b8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:28.563155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9ad25bab-fc2c-49c5-9066-290d10b663b8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:28.563630 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9ad25bab-fc2c-49c5-9066-290d10b663b8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:28.564053 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9ad25bab-fc2c-49c5-9066-290d10b663b8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:28.564895 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9ad25bab-fc2c-49c5-9066-290d10b663b8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:28.565331 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9ad25bab-fc2c-49c5-9066-290d10b663b8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:28.565768 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9ad25bab-fc2c-49c5-9066-290d10b663b8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:28.698810 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-9ad25bab-fc2c-49c5-9066-290d10b663b8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:28.707356 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-9ad25bab-fc2c-49c5-9066-290d10b663b8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:28.708773 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-9ad25bab-fc2c-49c5-9066-290d10b663b8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:28.709950 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-9ad25bab-fc2c-49c5-9066-290d10b663b8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1745 microversion: 2.20 time: 0.157924 Aug 31 10:02:28.710504 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 541/1065] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:28 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:29.732401 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-909e728c-16eb-4e3e-a0b4-31f47ccff775 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:29.733011 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-909e728c-16eb-4e3e-a0b4-31f47ccff775 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:29.740516 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-909e728c-16eb-4e3e-a0b4-31f47ccff775 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:29.741003 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-909e728c-16eb-4e3e-a0b4-31f47ccff775 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:29.741461 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-909e728c-16eb-4e3e-a0b4-31f47ccff775 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:29.742163 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-909e728c-16eb-4e3e-a0b4-31f47ccff775 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:29.742621 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-909e728c-16eb-4e3e-a0b4-31f47ccff775 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:29.743041 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-909e728c-16eb-4e3e-a0b4-31f47ccff775 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:29.874339 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-909e728c-16eb-4e3e-a0b4-31f47ccff775 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:29.883394 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-909e728c-16eb-4e3e-a0b4-31f47ccff775 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:29.884830 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-909e728c-16eb-4e3e-a0b4-31f47ccff775 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:29.886017 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-909e728c-16eb-4e3e-a0b4-31f47ccff775 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1745 microversion: 2.20 time: 0.157554 Aug 31 10:02:29.886579 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 525/1066] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:29 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:30.910436 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b4d58b62-1004-47a1-9730-c87d99d13e4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:30.911142 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b4d58b62-1004-47a1-9730-c87d99d13e4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:30.918407 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b4d58b62-1004-47a1-9730-c87d99d13e4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:30.919067 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b4d58b62-1004-47a1-9730-c87d99d13e4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:30.919706 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b4d58b62-1004-47a1-9730-c87d99d13e4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:30.920668 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b4d58b62-1004-47a1-9730-c87d99d13e4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:30.921186 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b4d58b62-1004-47a1-9730-c87d99d13e4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:30.921759 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b4d58b62-1004-47a1-9730-c87d99d13e4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:31.065810 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b4d58b62-1004-47a1-9730-c87d99d13e4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:31.074330 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b4d58b62-1004-47a1-9730-c87d99d13e4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:31.075756 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b4d58b62-1004-47a1-9730-c87d99d13e4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:31.076907 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b4d58b62-1004-47a1-9730-c87d99d13e4c tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1745 microversion: 2.20 time: 0.171167 Aug 31 10:02:31.077473 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 542/1067] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:30 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:31.600456 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-329230ab-982c-43d6-b447-20fee8f95058 req-72637dca-c818-49f2-b9fd-3df79a14c962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f34e6a94-72da-4a22-bab7-c5edbaae687c", "name": "network-vif-plugged", "status": "completed", "tag": "8abbd5d9-b7b2-4351-a7a3-78621eab95a0"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:02:31.612484 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-329230ab-982c-43d6-b447-20fee8f95058 req-72637dca-c818-49f2-b9fd-3df79a14c962 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:31.613223 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-329230ab-982c-43d6-b447-20fee8f95058 req-72637dca-c818-49f2-b9fd-3df79a14c962 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:31.613948 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-329230ab-982c-43d6-b447-20fee8f95058 req-72637dca-c818-49f2-b9fd-3df79a14c962 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:31.633320 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-329230ab-982c-43d6-b447-20fee8f95058 req-72637dca-c818-49f2-b9fd-3df79a14c962 service nova] Creating event network-vif-plugged:8abbd5d9-b7b2-4351-a7a3-78621eab95a0 for instance f34e6a94-72da-4a22-bab7-c5edbaae687c on hv-cinder-84496 Aug 31 10:02:31.650142 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-329230ab-982c-43d6-b447-20fee8f95058 req-72637dca-c818-49f2-b9fd-3df79a14c962 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053872 Aug 31 10:02:31.651434 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 526/1068] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 10:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:02:32.103899 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-2c5aae81-b458-454f-992e-dec64d3f8062 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:32.104508 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-2c5aae81-b458-454f-992e-dec64d3f8062 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:32.115319 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2c5aae81-b458-454f-992e-dec64d3f8062 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:32.116121 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2c5aae81-b458-454f-992e-dec64d3f8062 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:32.116946 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2c5aae81-b458-454f-992e-dec64d3f8062 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:32.118277 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2c5aae81-b458-454f-992e-dec64d3f8062 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:32.119185 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2c5aae81-b458-454f-992e-dec64d3f8062 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:32.120190 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2c5aae81-b458-454f-992e-dec64d3f8062 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:32.279742 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-2c5aae81-b458-454f-992e-dec64d3f8062 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:32.288723 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-2c5aae81-b458-454f-992e-dec64d3f8062 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:32.290269 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-2c5aae81-b458-454f-992e-dec64d3f8062 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:32.291362 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-2c5aae81-b458-454f-992e-dec64d3f8062 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1740 microversion: 2.20 time: 0.193454 Aug 31 10:02:32.295561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 543/1069] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:32 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:33.321434 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-767fe005-c9b8-4b69-b659-f46a99ed6f17 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:33.323111 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-767fe005-c9b8-4b69-b659-f46a99ed6f17 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:33.330147 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-767fe005-c9b8-4b69-b659-f46a99ed6f17 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:33.331498 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-767fe005-c9b8-4b69-b659-f46a99ed6f17 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:33.332138 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-767fe005-c9b8-4b69-b659-f46a99ed6f17 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:33.333054 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-767fe005-c9b8-4b69-b659-f46a99ed6f17 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:33.333555 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-767fe005-c9b8-4b69-b659-f46a99ed6f17 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:33.333981 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-767fe005-c9b8-4b69-b659-f46a99ed6f17 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:33.482948 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-767fe005-c9b8-4b69-b659-f46a99ed6f17 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:33.491951 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-767fe005-c9b8-4b69-b659-f46a99ed6f17 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:33.493857 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-767fe005-c9b8-4b69-b659-f46a99ed6f17 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:33.495311 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-767fe005-c9b8-4b69-b659-f46a99ed6f17 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1740 microversion: 2.20 time: 0.178267 Aug 31 10:02:33.496232 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 527/1070] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:33 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 10:02:34.521350 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-7e9db0b1-5ea4-4316-bfa6-69fb7ab8ac0a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:34.522630 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-7e9db0b1-5ea4-4316-bfa6-69fb7ab8ac0a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:34.528931 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7e9db0b1-5ea4-4316-bfa6-69fb7ab8ac0a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:34.529689 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7e9db0b1-5ea4-4316-bfa6-69fb7ab8ac0a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:34.530308 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7e9db0b1-5ea4-4316-bfa6-69fb7ab8ac0a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:34.531191 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7e9db0b1-5ea4-4316-bfa6-69fb7ab8ac0a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:34.531642 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7e9db0b1-5ea4-4316-bfa6-69fb7ab8ac0a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:34.532061 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-7e9db0b1-5ea4-4316-bfa6-69fb7ab8ac0a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:34.705245 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-7e9db0b1-5ea4-4316-bfa6-69fb7ab8ac0a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:34.714715 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-7e9db0b1-5ea4-4316-bfa6-69fb7ab8ac0a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:34.716176 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-7e9db0b1-5ea4-4316-bfa6-69fb7ab8ac0a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:34.717540 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-7e9db0b1-5ea4-4316-bfa6-69fb7ab8ac0a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1740 microversion: 2.20 time: 0.201645 Aug 31 10:02:34.721424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 544/1071] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:34 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:35.742950 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-f430fa2d-7d90-472e-b758-5c11895bf4a8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:35.743670 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-f430fa2d-7d90-472e-b758-5c11895bf4a8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:35.750382 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f430fa2d-7d90-472e-b758-5c11895bf4a8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:35.751112 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f430fa2d-7d90-472e-b758-5c11895bf4a8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:35.751613 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f430fa2d-7d90-472e-b758-5c11895bf4a8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:35.752950 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f430fa2d-7d90-472e-b758-5c11895bf4a8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:35.754307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f430fa2d-7d90-472e-b758-5c11895bf4a8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:35.754307 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-f430fa2d-7d90-472e-b758-5c11895bf4a8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:35.900346 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-f430fa2d-7d90-472e-b758-5c11895bf4a8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:35.910472 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-f430fa2d-7d90-472e-b758-5c11895bf4a8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:35.912011 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-f430fa2d-7d90-472e-b758-5c11895bf4a8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:35.913914 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-f430fa2d-7d90-472e-b758-5c11895bf4a8 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1740 microversion: 2.20 time: 0.174235 Aug 31 10:02:35.914067 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 528/1072] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:35 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:36.938135 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-6c03b4c2-4e9d-4348-9210-5924101b5584 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:36.938789 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-6c03b4c2-4e9d-4348-9210-5924101b5584 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:36.949139 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6c03b4c2-4e9d-4348-9210-5924101b5584 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:36.949659 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6c03b4c2-4e9d-4348-9210-5924101b5584 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:36.950092 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6c03b4c2-4e9d-4348-9210-5924101b5584 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:36.950886 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6c03b4c2-4e9d-4348-9210-5924101b5584 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:36.951332 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6c03b4c2-4e9d-4348-9210-5924101b5584 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:36.951745 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-6c03b4c2-4e9d-4348-9210-5924101b5584 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:37.119007 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-6c03b4c2-4e9d-4348-9210-5924101b5584 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:37.127730 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-6c03b4c2-4e9d-4348-9210-5924101b5584 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:37.129336 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-6c03b4c2-4e9d-4348-9210-5924101b5584 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:37.130576 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-6c03b4c2-4e9d-4348-9210-5924101b5584 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1740 microversion: 2.20 time: 0.197010 Aug 31 10:02:37.131142 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 545/1073] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:36 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:38.154560 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-8e6c1749-4454-467b-80dc-01d343c2ee91 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:38.155147 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-8e6c1749-4454-467b-80dc-01d343c2ee91 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:38.164432 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8e6c1749-4454-467b-80dc-01d343c2ee91 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:38.164923 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8e6c1749-4454-467b-80dc-01d343c2ee91 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:38.165360 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8e6c1749-4454-467b-80dc-01d343c2ee91 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:38.166116 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8e6c1749-4454-467b-80dc-01d343c2ee91 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:38.166570 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8e6c1749-4454-467b-80dc-01d343c2ee91 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:38.167113 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8e6c1749-4454-467b-80dc-01d343c2ee91 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:38.316282 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-8e6c1749-4454-467b-80dc-01d343c2ee91 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:38.325823 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-8e6c1749-4454-467b-80dc-01d343c2ee91 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:38.327308 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-8e6c1749-4454-467b-80dc-01d343c2ee91 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:38.328786 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-8e6c1749-4454-467b-80dc-01d343c2ee91 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1740 microversion: 2.20 time: 0.178396 Aug 31 10:02:38.342372 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 529/1074] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:38 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:39.353961 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-777d4d2f-268d-45db-bf7d-0c819b67add9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:39.354506 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-777d4d2f-268d-45db-bf7d-0c819b67add9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:39.361412 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-777d4d2f-268d-45db-bf7d-0c819b67add9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:39.362120 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-777d4d2f-268d-45db-bf7d-0c819b67add9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:39.363136 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-777d4d2f-268d-45db-bf7d-0c819b67add9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:39.363883 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-777d4d2f-268d-45db-bf7d-0c819b67add9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:39.364337 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-777d4d2f-268d-45db-bf7d-0c819b67add9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:39.364753 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-777d4d2f-268d-45db-bf7d-0c819b67add9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:39.527161 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-777d4d2f-268d-45db-bf7d-0c819b67add9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:39.536377 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-777d4d2f-268d-45db-bf7d-0c819b67add9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:39.537916 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-777d4d2f-268d-45db-bf7d-0c819b67add9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:39.539127 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-777d4d2f-268d-45db-bf7d-0c819b67add9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1740 microversion: 2.20 time: 0.189082 Aug 31 10:02:39.551798 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 546/1075] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:39 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:40.562598 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-592e0c6e-ad40-459c-9c51-232891848dd9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:40.563299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-592e0c6e-ad40-459c-9c51-232891848dd9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:40.571890 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-592e0c6e-ad40-459c-9c51-232891848dd9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:40.572878 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-592e0c6e-ad40-459c-9c51-232891848dd9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:40.573630 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-592e0c6e-ad40-459c-9c51-232891848dd9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:40.574833 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-592e0c6e-ad40-459c-9c51-232891848dd9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:40.575295 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-592e0c6e-ad40-459c-9c51-232891848dd9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:40.575646 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-592e0c6e-ad40-459c-9c51-232891848dd9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:40.712223 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-592e0c6e-ad40-459c-9c51-232891848dd9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:40.720316 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-592e0c6e-ad40-459c-9c51-232891848dd9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:40.722935 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-592e0c6e-ad40-459c-9c51-232891848dd9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:40.724102 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-592e0c6e-ad40-459c-9c51-232891848dd9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1740 microversion: 2.20 time: 0.165581 Aug 31 10:02:40.724661 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 530/1076] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:40 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:41.748065 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-9cad5392-83da-4ccc-94be-d0bdfcab68d1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:41.748678 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-9cad5392-83da-4ccc-94be-d0bdfcab68d1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:41.756443 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9cad5392-83da-4ccc-94be-d0bdfcab68d1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:41.756910 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9cad5392-83da-4ccc-94be-d0bdfcab68d1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:41.757344 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9cad5392-83da-4ccc-94be-d0bdfcab68d1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:41.758302 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9cad5392-83da-4ccc-94be-d0bdfcab68d1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:41.758772 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9cad5392-83da-4ccc-94be-d0bdfcab68d1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:41.759190 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9cad5392-83da-4ccc-94be-d0bdfcab68d1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:41.959038 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-9cad5392-83da-4ccc-94be-d0bdfcab68d1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:41.967260 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-9cad5392-83da-4ccc-94be-d0bdfcab68d1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:41.968716 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-9cad5392-83da-4ccc-94be-d0bdfcab68d1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:41.969999 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-9cad5392-83da-4ccc-94be-d0bdfcab68d1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1722 microversion: 2.20 time: 0.225766 Aug 31 10:02:41.971421 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 547/1077] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:41 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:42.994101 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c4439f37-77d5-4ade-b777-a82e5b366927 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:42.994706 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c4439f37-77d5-4ade-b777-a82e5b366927 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:43.001045 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4439f37-77d5-4ade-b777-a82e5b366927 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:43.001556 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4439f37-77d5-4ade-b777-a82e5b366927 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:43.002012 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4439f37-77d5-4ade-b777-a82e5b366927 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:43.003073 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4439f37-77d5-4ade-b777-a82e5b366927 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:43.003523 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4439f37-77d5-4ade-b777-a82e5b366927 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:43.003944 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c4439f37-77d5-4ade-b777-a82e5b366927 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:43.135116 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c4439f37-77d5-4ade-b777-a82e5b366927 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:43.143755 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c4439f37-77d5-4ade-b777-a82e5b366927 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:43.145364 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c4439f37-77d5-4ade-b777-a82e5b366927 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:43.146545 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c4439f37-77d5-4ade-b777-a82e5b366927 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1722 microversion: 2.20 time: 0.156410 Aug 31 10:02:43.147152 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 531/1078] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:42 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:44.169695 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-77ee7a14-80bd-493b-a45f-80202f8a4c9d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:44.170298 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-77ee7a14-80bd-493b-a45f-80202f8a4c9d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:44.176884 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-77ee7a14-80bd-493b-a45f-80202f8a4c9d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:44.177360 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-77ee7a14-80bd-493b-a45f-80202f8a4c9d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:44.177819 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-77ee7a14-80bd-493b-a45f-80202f8a4c9d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:44.178505 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-77ee7a14-80bd-493b-a45f-80202f8a4c9d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:44.178953 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-77ee7a14-80bd-493b-a45f-80202f8a4c9d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:44.179366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-77ee7a14-80bd-493b-a45f-80202f8a4c9d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:44.310832 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-77ee7a14-80bd-493b-a45f-80202f8a4c9d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:44.319617 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-77ee7a14-80bd-493b-a45f-80202f8a4c9d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:44.321050 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-77ee7a14-80bd-493b-a45f-80202f8a4c9d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:44.322238 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-77ee7a14-80bd-493b-a45f-80202f8a4c9d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1725 microversion: 2.20 time: 0.156583 Aug 31 10:02:44.322785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 548/1079] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:44 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:44.345663 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-4cb5cf42-1585-4dce-9f9e-46d41bb9f04b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8a91623-a21e-4fec-9352-7bc4cc7f14a2"}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:02:44.348685 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-4cb5cf42-1585-4dce-9f9e-46d41bb9f04b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:44.351190 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=29 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:02:44.356421 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4cb5cf42-1585-4dce-9f9e-46d41bb9f04b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:44.356900 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4cb5cf42-1585-4dce-9f9e-46d41bb9f04b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:44.357331 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4cb5cf42-1585-4dce-9f9e-46d41bb9f04b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:44.358061 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4cb5cf42-1585-4dce-9f9e-46d41bb9f04b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:44.358515 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4cb5cf42-1585-4dce-9f9e-46d41bb9f04b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:44.358934 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-4cb5cf42-1585-4dce-9f9e-46d41bb9f04b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:44.362236 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=79 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:02:44.652119 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-4cb5cf42-1585-4dce-9f9e-46d41bb9f04b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "POST /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.310471 Aug 31 10:02:44.652738 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 532/1080] 10.222.0.13 () {62 vars in 1364 bytes} [Wed Aug 31 10:02:44 2022] POST /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c/os-volume_attachments => generated 188 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:02:44.776490 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-86876e84-645b-4ae8-b647-a440241bdcfb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:44.776987 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-86876e84-645b-4ae8-b647-a440241bdcfb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:44.782910 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-86876e84-645b-4ae8-b647-a440241bdcfb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:44.783900 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-86876e84-645b-4ae8-b647-a440241bdcfb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:44.784332 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-86876e84-645b-4ae8-b647-a440241bdcfb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:44.785019 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-86876e84-645b-4ae8-b647-a440241bdcfb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:44.785491 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-86876e84-645b-4ae8-b647-a440241bdcfb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:44.785957 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-86876e84-645b-4ae8-b647-a440241bdcfb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:44.803882 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:02:45.028944 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-86876e84-645b-4ae8-b647-a440241bdcfb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c/os-volume_attachments/d8a91623-a21e-4fec-9352-7bc4cc7f14a2" status: 202 len: 0 microversion: 2.20 time: 0.256328 Aug 31 10:02:45.029562 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 549/1081] 10.222.0.13 () {60 vars in 1457 bytes} [Wed Aug 31 10:02:44 2022] DELETE /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c/os-volume_attachments/d8a91623-a21e-4fec-9352-7bc4cc7f14a2 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 10:02:45.092347 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c498d8fa-96d6-48cc-a6e7-ba12cd1eb284 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:02:45.093003 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c498d8fa-96d6-48cc-a6e7-ba12cd1eb284 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:45.099361 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c498d8fa-96d6-48cc-a6e7-ba12cd1eb284 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:45.099849 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c498d8fa-96d6-48cc-a6e7-ba12cd1eb284 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:45.100283 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c498d8fa-96d6-48cc-a6e7-ba12cd1eb284 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:45.101002 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c498d8fa-96d6-48cc-a6e7-ba12cd1eb284 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:45.101488 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c498d8fa-96d6-48cc-a6e7-ba12cd1eb284 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:45.101914 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c498d8fa-96d6-48cc-a6e7-ba12cd1eb284 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:45.132119 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c498d8fa-96d6-48cc-a6e7-ba12cd1eb284 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127171) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 10:02:45.199337 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c498d8fa-96d6-48cc-a6e7-ba12cd1eb284 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "POST /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c/action" status: 202 len: 0 microversion: 2.20 time: 0.110918 Aug 31 10:02:45.199953 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 533/1082] 10.222.0.13 () {62 vars in 1319 bytes} [Wed Aug 31 10:02:45 2022] POST /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 10:02:45.209110 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-1d07d78c-8a45-489d-817a-ae99e2b0114f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:45.209771 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-1d07d78c-8a45-489d-817a-ae99e2b0114f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:45.216293 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1d07d78c-8a45-489d-817a-ae99e2b0114f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:45.216775 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1d07d78c-8a45-489d-817a-ae99e2b0114f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:45.217238 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1d07d78c-8a45-489d-817a-ae99e2b0114f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:45.217984 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1d07d78c-8a45-489d-817a-ae99e2b0114f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:45.218415 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1d07d78c-8a45-489d-817a-ae99e2b0114f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:45.218830 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-1d07d78c-8a45-489d-817a-ae99e2b0114f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:45.361333 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-1d07d78c-8a45-489d-817a-ae99e2b0114f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:45.372115 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-1d07d78c-8a45-489d-817a-ae99e2b0114f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:45.373680 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-1d07d78c-8a45-489d-817a-ae99e2b0114f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:45.375151 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-1d07d78c-8a45-489d-817a-ae99e2b0114f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1673 microversion: 2.20 time: 0.171092 Aug 31 10:02:45.375702 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 550/1083] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:45 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:45.459082 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-97ed06e8-8459-4661-9d71-4a4939846df8 req-b654b1ed-b1a5-453a-bd41-450f76cfaa21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f34e6a94-72da-4a22-bab7-c5edbaae687c", "name": "network-vif-unplugged", "status": "completed", "tag": "8abbd5d9-b7b2-4351-a7a3-78621eab95a0"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:02:45.472148 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-97ed06e8-8459-4661-9d71-4a4939846df8 req-b654b1ed-b1a5-453a-bd41-450f76cfaa21 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:45.472716 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-97ed06e8-8459-4661-9d71-4a4939846df8 req-b654b1ed-b1a5-453a-bd41-450f76cfaa21 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:45.473221 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-97ed06e8-8459-4661-9d71-4a4939846df8 req-b654b1ed-b1a5-453a-bd41-450f76cfaa21 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:45.487198 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.compute.server_external_events [req-97ed06e8-8459-4661-9d71-4a4939846df8 req-b654b1ed-b1a5-453a-bd41-450f76cfaa21 service nova] Unable to find a host for instance f34e6a94-72da-4a22-bab7-c5edbaae687c. Dropping event network-vif-unplugged {{(pid=127171) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 10:02:45.488348 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-97ed06e8-8459-4661-9d71-4a4939846df8 req-b654b1ed-b1a5-453a-bd41-450f76cfaa21 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034451 Aug 31 10:02:45.489276 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 534/1084] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 10:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 31 10:02:46.399283 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f759057d-b84c-4f13-91cb-0be258780a5a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:46.399837 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-f759057d-b84c-4f13-91cb-0be258780a5a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:46.402106 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=33 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:02:46.407242 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f759057d-b84c-4f13-91cb-0be258780a5a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:46.407702 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f759057d-b84c-4f13-91cb-0be258780a5a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:46.408130 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f759057d-b84c-4f13-91cb-0be258780a5a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:46.409063 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f759057d-b84c-4f13-91cb-0be258780a5a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:46.409540 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f759057d-b84c-4f13-91cb-0be258780a5a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:46.409954 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f759057d-b84c-4f13-91cb-0be258780a5a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:46.595017 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-f759057d-b84c-4f13-91cb-0be258780a5a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:46.604097 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-f759057d-b84c-4f13-91cb-0be258780a5a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:46.605594 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-f759057d-b84c-4f13-91cb-0be258780a5a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:46.606748 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-f759057d-b84c-4f13-91cb-0be258780a5a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1731 microversion: 2.20 time: 0.211630 Aug 31 10:02:46.607341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 551/1085] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:46 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1731 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:47.632398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-960b521d-ca36-442c-b8ce-2dd5f3f2f1d5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:47.633946 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-960b521d-ca36-442c-b8ce-2dd5f3f2f1d5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:47.644695 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-960b521d-ca36-442c-b8ce-2dd5f3f2f1d5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:47.645759 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-960b521d-ca36-442c-b8ce-2dd5f3f2f1d5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:47.646548 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-960b521d-ca36-442c-b8ce-2dd5f3f2f1d5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:47.647687 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-960b521d-ca36-442c-b8ce-2dd5f3f2f1d5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:47.648502 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-960b521d-ca36-442c-b8ce-2dd5f3f2f1d5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:47.649201 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-960b521d-ca36-442c-b8ce-2dd5f3f2f1d5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:47.904613 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-960b521d-ca36-442c-b8ce-2dd5f3f2f1d5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:47.914641 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-960b521d-ca36-442c-b8ce-2dd5f3f2f1d5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:47.916360 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-960b521d-ca36-442c-b8ce-2dd5f3f2f1d5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:47.918000 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-960b521d-ca36-442c-b8ce-2dd5f3f2f1d5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1731 microversion: 2.20 time: 0.290871 Aug 31 10:02:47.919418 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 535/1086] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:47 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1731 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:48.943716 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-d3faa74e-60ed-46e3-a61c-c2c76d94838b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:48.944434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-d3faa74e-60ed-46e3-a61c-c2c76d94838b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:48.951532 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d3faa74e-60ed-46e3-a61c-c2c76d94838b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:48.952411 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d3faa74e-60ed-46e3-a61c-c2c76d94838b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:48.953190 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d3faa74e-60ed-46e3-a61c-c2c76d94838b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:48.954432 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d3faa74e-60ed-46e3-a61c-c2c76d94838b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:48.955678 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d3faa74e-60ed-46e3-a61c-c2c76d94838b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:48.956792 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d3faa74e-60ed-46e3-a61c-c2c76d94838b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:49.116155 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-d3faa74e-60ed-46e3-a61c-c2c76d94838b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:49.124363 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-d3faa74e-60ed-46e3-a61c-c2c76d94838b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:49.125818 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-d3faa74e-60ed-46e3-a61c-c2c76d94838b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:49.127010 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-d3faa74e-60ed-46e3-a61c-c2c76d94838b tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1731 microversion: 2.20 time: 0.188992 Aug 31 10:02:49.127570 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 552/1087] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:48 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:50.148491 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-138f05c7-616d-4f7b-8715-2444af7d10b9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:50.149119 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-138f05c7-616d-4f7b-8715-2444af7d10b9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:50.155682 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-138f05c7-616d-4f7b-8715-2444af7d10b9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:50.156170 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-138f05c7-616d-4f7b-8715-2444af7d10b9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:50.156609 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-138f05c7-616d-4f7b-8715-2444af7d10b9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:50.157299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-138f05c7-616d-4f7b-8715-2444af7d10b9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:50.157779 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-138f05c7-616d-4f7b-8715-2444af7d10b9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:50.158206 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-138f05c7-616d-4f7b-8715-2444af7d10b9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:50.290022 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-138f05c7-616d-4f7b-8715-2444af7d10b9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:50.299160 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-138f05c7-616d-4f7b-8715-2444af7d10b9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:50.301447 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-138f05c7-616d-4f7b-8715-2444af7d10b9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:50.302764 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-138f05c7-616d-4f7b-8715-2444af7d10b9 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1731 microversion: 2.20 time: 0.158179 Aug 31 10:02:50.317890 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 536/1088] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:50 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:51.326502 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b4558d83-04e4-486a-b088-cf8b1dace512 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:51.327057 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b4558d83-04e4-486a-b088-cf8b1dace512 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:51.334311 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b4558d83-04e4-486a-b088-cf8b1dace512 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:51.334789 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b4558d83-04e4-486a-b088-cf8b1dace512 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:51.335223 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b4558d83-04e4-486a-b088-cf8b1dace512 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:51.335910 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b4558d83-04e4-486a-b088-cf8b1dace512 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:51.336360 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b4558d83-04e4-486a-b088-cf8b1dace512 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:51.336778 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b4558d83-04e4-486a-b088-cf8b1dace512 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:51.535156 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b4558d83-04e4-486a-b088-cf8b1dace512 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:51.543594 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b4558d83-04e4-486a-b088-cf8b1dace512 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:51.545021 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b4558d83-04e4-486a-b088-cf8b1dace512 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:51.546205 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b4558d83-04e4-486a-b088-cf8b1dace512 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1731 microversion: 2.20 time: 0.223826 Aug 31 10:02:51.547068 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 553/1089] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:51 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1731 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:52.569632 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-2b41a1a2-43bd-451b-90eb-c0ea7defefb5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:52.570241 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-2b41a1a2-43bd-451b-90eb-c0ea7defefb5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:52.576561 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2b41a1a2-43bd-451b-90eb-c0ea7defefb5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:52.577041 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2b41a1a2-43bd-451b-90eb-c0ea7defefb5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:52.577531 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2b41a1a2-43bd-451b-90eb-c0ea7defefb5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:52.578215 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2b41a1a2-43bd-451b-90eb-c0ea7defefb5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:52.578655 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2b41a1a2-43bd-451b-90eb-c0ea7defefb5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:52.579065 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2b41a1a2-43bd-451b-90eb-c0ea7defefb5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:52.732396 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2b41a1a2-43bd-451b-90eb-c0ea7defefb5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:52.741185 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2b41a1a2-43bd-451b-90eb-c0ea7defefb5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:52.742652 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2b41a1a2-43bd-451b-90eb-c0ea7defefb5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:52.743823 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-2b41a1a2-43bd-451b-90eb-c0ea7defefb5 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1731 microversion: 2.20 time: 0.178199 Aug 31 10:02:52.744576 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 537/1090] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:52 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:53.767473 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-81c585c8-9df1-47fa-affa-711daed75412 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:53.768157 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-81c585c8-9df1-47fa-affa-711daed75412 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:53.775914 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-81c585c8-9df1-47fa-affa-711daed75412 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:53.776594 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-81c585c8-9df1-47fa-affa-711daed75412 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:53.777030 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-81c585c8-9df1-47fa-affa-711daed75412 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:53.777885 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-81c585c8-9df1-47fa-affa-711daed75412 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:53.778412 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-81c585c8-9df1-47fa-affa-711daed75412 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:53.778839 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-81c585c8-9df1-47fa-affa-711daed75412 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:53.927851 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-81c585c8-9df1-47fa-affa-711daed75412 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:53.936101 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-81c585c8-9df1-47fa-affa-711daed75412 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:53.937560 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-81c585c8-9df1-47fa-affa-711daed75412 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:53.938763 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-81c585c8-9df1-47fa-affa-711daed75412 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1731 microversion: 2.20 time: 0.175332 Aug 31 10:02:53.939328 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 554/1091] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:53 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:54.966167 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c41ca237-5a35-4817-804d-bf10885edb65 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:54.967407 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c41ca237-5a35-4817-804d-bf10885edb65 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:54.974754 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c41ca237-5a35-4817-804d-bf10885edb65 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:54.975238 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c41ca237-5a35-4817-804d-bf10885edb65 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:54.975670 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c41ca237-5a35-4817-804d-bf10885edb65 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:54.976645 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c41ca237-5a35-4817-804d-bf10885edb65 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:54.976793 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c41ca237-5a35-4817-804d-bf10885edb65 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:54.977210 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c41ca237-5a35-4817-804d-bf10885edb65 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:55.134723 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c41ca237-5a35-4817-804d-bf10885edb65 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:55.144154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c41ca237-5a35-4817-804d-bf10885edb65 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:55.146333 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c41ca237-5a35-4817-804d-bf10885edb65 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:55.147535 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c41ca237-5a35-4817-804d-bf10885edb65 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1731 microversion: 2.20 time: 0.185283 Aug 31 10:02:55.148300 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 538/1092] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:54 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:56.174674 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-2ff31e50-2d73-4978-9c0e-d621e7b4f3b4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:56.175965 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-2ff31e50-2d73-4978-9c0e-d621e7b4f3b4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:56.187305 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2ff31e50-2d73-4978-9c0e-d621e7b4f3b4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:56.188084 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2ff31e50-2d73-4978-9c0e-d621e7b4f3b4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:56.189807 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2ff31e50-2d73-4978-9c0e-d621e7b4f3b4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:56.190706 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2ff31e50-2d73-4978-9c0e-d621e7b4f3b4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:56.193263 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2ff31e50-2d73-4978-9c0e-d621e7b4f3b4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:56.194052 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-2ff31e50-2d73-4978-9c0e-d621e7b4f3b4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:56.333854 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-2ff31e50-2d73-4978-9c0e-d621e7b4f3b4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:56.341868 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-2ff31e50-2d73-4978-9c0e-d621e7b4f3b4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:56.343293 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-2ff31e50-2d73-4978-9c0e-d621e7b4f3b4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:56.344423 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-2ff31e50-2d73-4978-9c0e-d621e7b4f3b4 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1731 microversion: 2.20 time: 0.173957 Aug 31 10:02:56.344970 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 555/1093] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:56 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:57.369141 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-533fb500-38c0-4a95-b127-09dd1b63f98d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:57.370098 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-533fb500-38c0-4a95-b127-09dd1b63f98d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:57.377021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-533fb500-38c0-4a95-b127-09dd1b63f98d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:57.377529 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-533fb500-38c0-4a95-b127-09dd1b63f98d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:57.377962 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-533fb500-38c0-4a95-b127-09dd1b63f98d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:57.378658 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-533fb500-38c0-4a95-b127-09dd1b63f98d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:57.379116 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-533fb500-38c0-4a95-b127-09dd1b63f98d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:57.379528 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-533fb500-38c0-4a95-b127-09dd1b63f98d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:57.511489 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-533fb500-38c0-4a95-b127-09dd1b63f98d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:57.520236 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-533fb500-38c0-4a95-b127-09dd1b63f98d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:57.521775 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-533fb500-38c0-4a95-b127-09dd1b63f98d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:57.522942 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-533fb500-38c0-4a95-b127-09dd1b63f98d tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1731 microversion: 2.20 time: 0.157961 Aug 31 10:02:57.523508 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 539/1094] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:57 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:58.545415 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-4f9c1987-ee04-49ac-8b0b-e2adb30dc2cb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:58.546059 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-4f9c1987-ee04-49ac-8b0b-e2adb30dc2cb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:58.552488 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4f9c1987-ee04-49ac-8b0b-e2adb30dc2cb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:58.552958 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4f9c1987-ee04-49ac-8b0b-e2adb30dc2cb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:58.553465 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4f9c1987-ee04-49ac-8b0b-e2adb30dc2cb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:58.554150 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4f9c1987-ee04-49ac-8b0b-e2adb30dc2cb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:58.554592 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4f9c1987-ee04-49ac-8b0b-e2adb30dc2cb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:58.555004 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-4f9c1987-ee04-49ac-8b0b-e2adb30dc2cb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:58.687908 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-4f9c1987-ee04-49ac-8b0b-e2adb30dc2cb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:58.697256 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-4f9c1987-ee04-49ac-8b0b-e2adb30dc2cb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:58.698732 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-4f9c1987-ee04-49ac-8b0b-e2adb30dc2cb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:58.699961 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-4f9c1987-ee04-49ac-8b0b-e2adb30dc2cb tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1731 microversion: 2.20 time: 0.158412 Aug 31 10:02:58.700648 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 556/1095] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:58 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:02:59.723163 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-7fc0209f-14d0-49ef-a123-f4b7185b607a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:59.723845 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-7fc0209f-14d0-49ef-a123-f4b7185b607a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:59.730303 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7fc0209f-14d0-49ef-a123-f4b7185b607a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:59.730778 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7fc0209f-14d0-49ef-a123-f4b7185b607a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:59.731207 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7fc0209f-14d0-49ef-a123-f4b7185b607a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:59.731884 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7fc0209f-14d0-49ef-a123-f4b7185b607a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:59.732329 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7fc0209f-14d0-49ef-a123-f4b7185b607a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:59.732740 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7fc0209f-14d0-49ef-a123-f4b7185b607a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:59.862846 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7fc0209f-14d0-49ef-a123-f4b7185b607a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:59.871910 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7fc0209f-14d0-49ef-a123-f4b7185b607a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:59.873338 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7fc0209f-14d0-49ef-a123-f4b7185b607a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:59.874548 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-7fc0209f-14d0-49ef-a123-f4b7185b607a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1731 microversion: 2.20 time: 0.155803 Aug 31 10:02:59.875105 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 540/1096] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:02:59 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:03:00.898152 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-18a39379-a3e9-4018-8444-6002ebab8a55 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:03:00.898777 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-18a39379-a3e9-4018-8444-6002ebab8a55 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:03:00.905499 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-18a39379-a3e9-4018-8444-6002ebab8a55 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:00.905970 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-18a39379-a3e9-4018-8444-6002ebab8a55 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:00.906393 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-18a39379-a3e9-4018-8444-6002ebab8a55 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:00.907518 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-18a39379-a3e9-4018-8444-6002ebab8a55 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:00.907518 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-18a39379-a3e9-4018-8444-6002ebab8a55 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:00.907909 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-18a39379-a3e9-4018-8444-6002ebab8a55 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:01.045116 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-18a39379-a3e9-4018-8444-6002ebab8a55 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:03:01.053541 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-18a39379-a3e9-4018-8444-6002ebab8a55 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:03:01.054967 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-18a39379-a3e9-4018-8444-6002ebab8a55 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:03:01.056131 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-18a39379-a3e9-4018-8444-6002ebab8a55 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1731 microversion: 2.20 time: 0.162714 Aug 31 10:03:01.056817 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 557/1097] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:03:00 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:03:02.079378 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-da563aee-c776-40b4-a305-b0084f997986 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:03:02.079994 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-da563aee-c776-40b4-a305-b0084f997986 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:03:02.087085 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-da563aee-c776-40b4-a305-b0084f997986 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:02.087576 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-da563aee-c776-40b4-a305-b0084f997986 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:02.088020 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-da563aee-c776-40b4-a305-b0084f997986 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:02.088734 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-da563aee-c776-40b4-a305-b0084f997986 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:02.089170 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-da563aee-c776-40b4-a305-b0084f997986 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:02.089636 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-da563aee-c776-40b4-a305-b0084f997986 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:02.220290 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-da563aee-c776-40b4-a305-b0084f997986 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:03:02.229617 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-da563aee-c776-40b4-a305-b0084f997986 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:03:02.230998 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-da563aee-c776-40b4-a305-b0084f997986 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:03:02.232157 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-da563aee-c776-40b4-a305-b0084f997986 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1731 microversion: 2.20 time: 0.156744 Aug 31 10:03:02.232718 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 541/1098] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:03:02 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:03:03.257969 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-c8b725bc-ef35-4157-8d38-567abea9e185 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:03:03.257969 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-c8b725bc-ef35-4157-8d38-567abea9e185 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:03:03.265314 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8b725bc-ef35-4157-8d38-567abea9e185 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:03.265314 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8b725bc-ef35-4157-8d38-567abea9e185 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:03.265314 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8b725bc-ef35-4157-8d38-567abea9e185 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:03.265745 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8b725bc-ef35-4157-8d38-567abea9e185 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:03.266067 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8b725bc-ef35-4157-8d38-567abea9e185 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:03.266489 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c8b725bc-ef35-4157-8d38-567abea9e185 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:03.410998 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-c8b725bc-ef35-4157-8d38-567abea9e185 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:03:03.419149 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-c8b725bc-ef35-4157-8d38-567abea9e185 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:03:03.420559 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-c8b725bc-ef35-4157-8d38-567abea9e185 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:03:03.421750 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-c8b725bc-ef35-4157-8d38-567abea9e185 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1731 microversion: 2.20 time: 0.169294 Aug 31 10:03:03.422539 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 558/1099] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:03:03 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:03:04.445537 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-9179324b-ba71-4930-bcc0-ae367ed58c5e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:03:04.446150 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-9179324b-ba71-4930-bcc0-ae367ed58c5e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:03:04.452609 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9179324b-ba71-4930-bcc0-ae367ed58c5e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:04.453090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9179324b-ba71-4930-bcc0-ae367ed58c5e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:04.453571 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9179324b-ba71-4930-bcc0-ae367ed58c5e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:04.454262 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9179324b-ba71-4930-bcc0-ae367ed58c5e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:04.454712 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9179324b-ba71-4930-bcc0-ae367ed58c5e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:04.455133 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-9179324b-ba71-4930-bcc0-ae367ed58c5e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:04.588744 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-9179324b-ba71-4930-bcc0-ae367ed58c5e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:03:04.596867 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-9179324b-ba71-4930-bcc0-ae367ed58c5e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:03:04.598345 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-9179324b-ba71-4930-bcc0-ae367ed58c5e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:03:04.599493 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-9179324b-ba71-4930-bcc0-ae367ed58c5e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1731 microversion: 2.20 time: 0.158926 Aug 31 10:03:04.600050 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 542/1100] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:03:04 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:03:05.573854 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-494a52b5-8b92-4860-89ef-9cd71ac45526 req-6735a3b7-212b-478a-8550-9348e6a76024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f34e6a94-72da-4a22-bab7-c5edbaae687c", "name": "network-vif-plugged", "status": "completed", "tag": "8abbd5d9-b7b2-4351-a7a3-78621eab95a0"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:03:05.586017 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-494a52b5-8b92-4860-89ef-9cd71ac45526 req-6735a3b7-212b-478a-8550-9348e6a76024 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:05.586531 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-494a52b5-8b92-4860-89ef-9cd71ac45526 req-6735a3b7-212b-478a-8550-9348e6a76024 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:05.586974 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-494a52b5-8b92-4860-89ef-9cd71ac45526 req-6735a3b7-212b-478a-8550-9348e6a76024 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:05.599009 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-494a52b5-8b92-4860-89ef-9cd71ac45526 req-6735a3b7-212b-478a-8550-9348e6a76024 service nova] Creating event network-vif-plugged:8abbd5d9-b7b2-4351-a7a3-78621eab95a0 for instance f34e6a94-72da-4a22-bab7-c5edbaae687c on hv-cinder-84496 Aug 31 10:03:05.604345 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-494a52b5-8b92-4860-89ef-9cd71ac45526 req-6735a3b7-212b-478a-8550-9348e6a76024 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034268 Aug 31 10:03:05.605507 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 559/1101] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 10:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:03:05.622181 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-15179e41-fd43-4fd9-9254-103716193abf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:03:05.622794 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-15179e41-fd43-4fd9-9254-103716193abf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:03:05.630305 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-15179e41-fd43-4fd9-9254-103716193abf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:05.630819 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-15179e41-fd43-4fd9-9254-103716193abf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:05.631263 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-15179e41-fd43-4fd9-9254-103716193abf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:05.632353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-15179e41-fd43-4fd9-9254-103716193abf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:05.632461 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-15179e41-fd43-4fd9-9254-103716193abf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:05.632828 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-15179e41-fd43-4fd9-9254-103716193abf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:05.773675 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-15179e41-fd43-4fd9-9254-103716193abf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:03:05.781851 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-15179e41-fd43-4fd9-9254-103716193abf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:03:05.783299 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-15179e41-fd43-4fd9-9254-103716193abf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:03:05.784463 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-15179e41-fd43-4fd9-9254-103716193abf tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1731 microversion: 2.20 time: 0.166226 Aug 31 10:03:05.791823 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 543/1102] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:03:05 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:03:06.808197 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b880334e-3cc6-473a-915b-1c8ff4d6a016 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:03:06.808885 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b880334e-3cc6-473a-915b-1c8ff4d6a016 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:03:06.815520 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b880334e-3cc6-473a-915b-1c8ff4d6a016 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:06.816000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b880334e-3cc6-473a-915b-1c8ff4d6a016 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:06.817687 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b880334e-3cc6-473a-915b-1c8ff4d6a016 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:06.818392 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b880334e-3cc6-473a-915b-1c8ff4d6a016 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:06.818852 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b880334e-3cc6-473a-915b-1c8ff4d6a016 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:06.819281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b880334e-3cc6-473a-915b-1c8ff4d6a016 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:07.025720 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b880334e-3cc6-473a-915b-1c8ff4d6a016 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:03:07.034006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b880334e-3cc6-473a-915b-1c8ff4d6a016 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:03:07.036230 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b880334e-3cc6-473a-915b-1c8ff4d6a016 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:03:07.037471 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b880334e-3cc6-473a-915b-1c8ff4d6a016 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1731 microversion: 2.20 time: 0.233562 Aug 31 10:03:07.038060 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 560/1103] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:03:06 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1731 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:03:08.060855 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-2c616af8-31dc-4157-9949-a155421530f7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:03:08.061477 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-2c616af8-31dc-4157-9949-a155421530f7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:03:08.069747 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2c616af8-31dc-4157-9949-a155421530f7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:08.070270 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2c616af8-31dc-4157-9949-a155421530f7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:08.070704 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2c616af8-31dc-4157-9949-a155421530f7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:08.071407 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2c616af8-31dc-4157-9949-a155421530f7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:03:08.071856 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2c616af8-31dc-4157-9949-a155421530f7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:03:08.072275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2c616af8-31dc-4157-9949-a155421530f7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:03:08.203908 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2c616af8-31dc-4157-9949-a155421530f7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:03:08.212662 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2c616af8-31dc-4157-9949-a155421530f7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:03:08.214120 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2c616af8-31dc-4157-9949-a155421530f7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:03:08.215275 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-2c616af8-31dc-4157-9949-a155421530f7 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1718 microversion: 2.20 time: 0.158321 Aug 31 10:03:08.215833 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 544/1104] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:03:08 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:04:03.793611 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-27714ac6-6f48-44aa-8bc2-a24e070f75b1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:04:03.795871 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-27714ac6-6f48-44aa-8bc2-a24e070f75b1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:04:03.797989 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=19 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:04:03.798640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:04:03.799763 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 10:04:03.799943 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Wed Aug 31 10:04:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c/os-volume_attachments (ip 10.222.0.13) !!! Aug 31 10:04:03.810376 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-27714ac6-6f48-44aa-8bc2-a24e070f75b1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:04:03.810859 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-27714ac6-6f48-44aa-8bc2-a24e070f75b1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:04:03.811297 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-27714ac6-6f48-44aa-8bc2-a24e070f75b1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:04:03.812011 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-27714ac6-6f48-44aa-8bc2-a24e070f75b1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:04:03.812458 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-27714ac6-6f48-44aa-8bc2-a24e070f75b1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:04:03.812879 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-27714ac6-6f48-44aa-8bc2-a24e070f75b1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:04:03.843681 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-27714ac6-6f48-44aa-8bc2-a24e070f75b1 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055117 Aug 31 10:04:03.844265 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 561/1105] 10.222.0.13 () {60 vars in 1343 bytes} [Wed Aug 31 10:04:03 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:04:03.906593 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-0584b651-c225-49d6-b090-23a21de5a126 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:04:03.907162 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-0584b651-c225-49d6-b090-23a21de5a126 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:04:03.909279 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:04:03.910164 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:04:03.911197 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 10:04:03.911358 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Wed Aug 31 10:04:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c (ip 10.222.0.13) !!! Aug 31 10:04:03.920330 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0584b651-c225-49d6-b090-23a21de5a126 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:04:03.920893 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0584b651-c225-49d6-b090-23a21de5a126 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:04:03.921337 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0584b651-c225-49d6-b090-23a21de5a126 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:04:03.922067 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0584b651-c225-49d6-b090-23a21de5a126 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:04:03.922526 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0584b651-c225-49d6-b090-23a21de5a126 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:04:03.922954 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0584b651-c225-49d6-b090-23a21de5a126 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:04:03.953128 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-0584b651-c225-49d6-b090-23a21de5a126 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Going to try to terminate instance {{(pid=127171) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 10:04:04.031352 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-0584b651-c225-49d6-b090-23a21de5a126 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 204 len: 0 microversion: 2.20 time: 0.128274 Aug 31 10:04:04.031977 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 545/1106] 10.222.0.13 () {60 vars in 1280 bytes} [Wed Aug 31 10:04:03 2022] DELETE /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 10:04:04.041285 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-ff03565b-5e8c-42c1-ba2b-3e0f52a825cc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:04:04.042289 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-ff03565b-5e8c-42c1-ba2b-3e0f52a825cc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:04:04.048321 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ff03565b-5e8c-42c1-ba2b-3e0f52a825cc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:04:04.048937 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ff03565b-5e8c-42c1-ba2b-3e0f52a825cc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:04:04.049257 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ff03565b-5e8c-42c1-ba2b-3e0f52a825cc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:04:04.049979 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ff03565b-5e8c-42c1-ba2b-3e0f52a825cc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:04:04.050425 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ff03565b-5e8c-42c1-ba2b-3e0f52a825cc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:04:04.050837 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-ff03565b-5e8c-42c1-ba2b-3e0f52a825cc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:04:04.182182 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-ff03565b-5e8c-42c1-ba2b-3e0f52a825cc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:04:04.190750 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-ff03565b-5e8c-42c1-ba2b-3e0f52a825cc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:04:04.192291 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-ff03565b-5e8c-42c1-ba2b-3e0f52a825cc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:04:04.193462 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-ff03565b-5e8c-42c1-ba2b-3e0f52a825cc tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1724 microversion: 2.20 time: 0.157109 Aug 31 10:04:04.194019 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 562/1107] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:04:04 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:04:05.217018 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-2d7da98e-e3dd-40ea-b90e-c13f87ecf26f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:04:05.217772 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-2d7da98e-e3dd-40ea-b90e-c13f87ecf26f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:04:05.224294 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2d7da98e-e3dd-40ea-b90e-c13f87ecf26f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:04:05.224776 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2d7da98e-e3dd-40ea-b90e-c13f87ecf26f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:04:05.225208 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2d7da98e-e3dd-40ea-b90e-c13f87ecf26f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:04:05.225982 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2d7da98e-e3dd-40ea-b90e-c13f87ecf26f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:04:05.226382 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2d7da98e-e3dd-40ea-b90e-c13f87ecf26f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:04:05.226802 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2d7da98e-e3dd-40ea-b90e-c13f87ecf26f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:04:05.358956 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2d7da98e-e3dd-40ea-b90e-c13f87ecf26f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:04:05.367366 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2d7da98e-e3dd-40ea-b90e-c13f87ecf26f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:04:05.369372 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2d7da98e-e3dd-40ea-b90e-c13f87ecf26f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:04:05.370835 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-2d7da98e-e3dd-40ea-b90e-c13f87ecf26f tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1724 microversion: 2.20 time: 0.158448 Aug 31 10:04:05.371399 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 546/1108] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:04:05 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 10:04:06.394220 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-fe7d478c-1a97-49cd-ac02-06caca84240e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:04:06.394852 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-fe7d478c-1a97-49cd-ac02-06caca84240e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:04:06.402679 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fe7d478c-1a97-49cd-ac02-06caca84240e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:04:06.403159 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fe7d478c-1a97-49cd-ac02-06caca84240e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:04:06.403586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fe7d478c-1a97-49cd-ac02-06caca84240e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:04:06.404274 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fe7d478c-1a97-49cd-ac02-06caca84240e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:04:06.404715 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fe7d478c-1a97-49cd-ac02-06caca84240e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:04:06.405128 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fe7d478c-1a97-49cd-ac02-06caca84240e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:04:06.476470 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-fe7d478c-1a97-49cd-ac02-06caca84240e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:04:06.485375 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-fe7d478c-1a97-49cd-ac02-06caca84240e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:04:06.487126 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-fe7d478c-1a97-49cd-ac02-06caca84240e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6dc6f70f3b1b40d9be1f9d01da0de1f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a68bf51dcd404f559e9ae2efeb185712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:04:06.488334 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-fe7d478c-1a97-49cd-ac02-06caca84240e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 200 len: 1656 microversion: 2.20 time: 0.098052 Aug 31 10:04:06.488889 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 563/1109] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:04:06 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 1656 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:04:06.579698 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-838492ff-c5c1-4d5d-804a-ca88d071ea70 req-d3f9a688-a89c-41ee-b531-61753dbe01c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f34e6a94-72da-4a22-bab7-c5edbaae687c", "name": "network-vif-deleted", "tag": "8abbd5d9-b7b2-4351-a7a3-78621eab95a0"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:04:06.592968 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-838492ff-c5c1-4d5d-804a-ca88d071ea70 req-d3f9a688-a89c-41ee-b531-61753dbe01c4 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:04:06.593481 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-838492ff-c5c1-4d5d-804a-ca88d071ea70 req-d3f9a688-a89c-41ee-b531-61753dbe01c4 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:04:06.594940 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-838492ff-c5c1-4d5d-804a-ca88d071ea70 req-d3f9a688-a89c-41ee-b531-61753dbe01c4 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:04:06.607439 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-838492ff-c5c1-4d5d-804a-ca88d071ea70 req-d3f9a688-a89c-41ee-b531-61753dbe01c4 service nova] Creating event network-vif-deleted:8abbd5d9-b7b2-4351-a7a3-78621eab95a0 for instance f34e6a94-72da-4a22-bab7-c5edbaae687c on hv-cinder-84496 Aug 31 10:04:06.614438 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-838492ff-c5c1-4d5d-804a-ca88d071ea70 req-d3f9a688-a89c-41ee-b531-61753dbe01c4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038337 Aug 31 10:04:06.616805 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 547/1110] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 10:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:04:07.512333 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-0df25aa2-52a1-4e69-a84c-5409509c74ca tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:04:07.512881 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-0df25aa2-52a1-4e69-a84c-5409509c74ca tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:04:07.519384 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0df25aa2-52a1-4e69-a84c-5409509c74ca tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:04:07.519867 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0df25aa2-52a1-4e69-a84c-5409509c74ca tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:04:07.520300 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0df25aa2-52a1-4e69-a84c-5409509c74ca tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:04:07.521000 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0df25aa2-52a1-4e69-a84c-5409509c74ca tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:04:07.521480 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0df25aa2-52a1-4e69-a84c-5409509c74ca tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:04:07.521900 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0df25aa2-52a1-4e69-a84c-5409509c74ca tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:04:07.536634 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-0df25aa2-52a1-4e69-a84c-5409509c74ca tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] HTTP exception thrown: Instance f34e6a94-72da-4a22-bab7-c5edbaae687c could not be found. Aug 31 10:04:07.538341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-0df25aa2-52a1-4e69-a84c-5409509c74ca tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Request method failure captured: Aug 31 10:04:07.538341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c HTTP/1.1 Aug 31 10:04:07.538341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 10:04:07.538341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 10:04:07.538341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 10:04:07.538341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 10:04:07.538341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 10:04:07.538341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 10:04:07.538341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 10:04:07.538341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 10:04:07.538341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDzA7RlgTqPbJ9x6G0d-icAmjdYoPScrNsrptUHwqdSDU1jyZjMduoMif0Yt1IPs0AW80HY2woB2gsC1-lK-cDpj7S0ZbQD96sNUp_78FGLaQTbAH1oaAb119vxMKAGYTUbI2NFyXAVZ1QC9EzH4PsDkEWeDAfeeTiE6hZBrrVlf2rU8 Aug 31 10:04:07.538341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 10:04:07.538341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 10:04:07.538341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 10:04:07.538341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 10:04:07.538341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 10:04:07.538341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 10:04:07.538341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 10:04:07.538341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: a68bf51dcd404f559e9ae2efeb185712 Aug 31 10:04:07.538341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2121567059 Aug 31 10:04:07.538341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 10:04:07.538341 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 10:04:07.540095 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a68bf51dcd404f559e9ae2efeb185712"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a68bf51dcd404f559e9ae2efeb185712"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a68bf51dcd404f559e9ae2efeb185712"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a68bf51dcd404f559e9ae2efeb185712"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 10:04:07.540095 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2121567059 Aug 31 10:04:07.540095 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: a68bf51dcd404f559e9ae2efeb185712 Aug 31 10:04:07.540095 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2121567059 Aug 31 10:04:07.540095 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-AttachVolumeShelveTestJSON-2121567059-project Aug 31 10:04:07.540095 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 10:04:07.540095 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 10:04:07.540095 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: 6dc6f70f3b1b40d9be1f9d01da0de1f1 Aug 31 10:04:07.540095 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2121567059-project Aug 31 10:04:07.540095 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 10:04:07.540095 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Instance f34e6a94-72da-4a22-bab7-c5edbaae687c could not be found. Aug 31 10:04:07.540095 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': 'f34e6a94-72da-4a22-bab7-c5edbaae687c'} Aug 31 10:04:07.542191 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:04:07.542191 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:04:07.542191 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:04:07.542191 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:04:07.542191 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:04:07.542191 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:04:07.542191 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:04:07.542191 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:04:07.542191 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:04:07.542191 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:04:07.542191 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f34e6a94-72da-4a22-bab7-c5edbaae687c could not be found. Aug 31 10:04:07.542191 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:04:07.542191 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:04:07.542191 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:04:07.542191 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:04:07.542191 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:04:07.542191 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:04:07.542191 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:04:07.542191 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:04:07.542191 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:04:07.543544 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:04:07.543544 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:04:07.543544 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:04:07.543544 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:04:07.543544 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:04:07.543544 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:04:07.543544 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:04:07.543544 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f34e6a94-72da-4a22-bab7-c5edbaae687c could not be found. Aug 31 10:04:07.543544 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:04:07.543544 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:04:07.543544 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:04:07.543544 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:04:07.543544 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:04:07.543544 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:04:07.543544 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:04:07.543544 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:04:07.543544 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f34e6a94-72da-4a22-bab7-c5edbaae687c could not be found. Aug 31 10:04:07.543544 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:04:07.546345 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-0df25aa2-52a1-4e69-a84c-5409509c74ca tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Returning 404 to user: Instance f34e6a94-72da-4a22-bab7-c5edbaae687c could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:04:07.546345 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-0df25aa2-52a1-4e69-a84c-5409509c74ca tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 404 len: 111 microversion: 2.20 time: 0.031739 Aug 31 10:04:07.546345 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 564/1111] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:04:07 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 10:04:07.550462 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-ad43e076-02c9-41c8-bee2-0c106d23e7da tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '.version_select at 0x7f55080dc040>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:04:07.592288 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-ad43e076-02c9-41c8-bee2-0c106d23e7da tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-413083005" status: 204 len: 0 microversion: 2.20 time: 0.046014 Aug 31 10:04:07.593260 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 548/1112] 10.222.0.13 () {60 vars in 1259 bytes} [Wed Aug 31 10:04:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-413083005 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 10:04:09.370070 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-cb6f58ad-37e6-43aa-9a1c-ae8de202e182 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:04:09.370649 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-cb6f58ad-37e6-43aa-9a1c-ae8de202e182 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:04:09.376941 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb6f58ad-37e6-43aa-9a1c-ae8de202e182 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:04:09.377451 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb6f58ad-37e6-43aa-9a1c-ae8de202e182 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:04:09.377882 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb6f58ad-37e6-43aa-9a1c-ae8de202e182 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:04:09.378562 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb6f58ad-37e6-43aa-9a1c-ae8de202e182 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:04:09.379005 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb6f58ad-37e6-43aa-9a1c-ae8de202e182 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:04:09.379421 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-cb6f58ad-37e6-43aa-9a1c-ae8de202e182 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:04:09.392583 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-cb6f58ad-37e6-43aa-9a1c-ae8de202e182 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] HTTP exception thrown: Instance f34e6a94-72da-4a22-bab7-c5edbaae687c could not be found. Aug 31 10:04:09.394180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-cb6f58ad-37e6-43aa-9a1c-ae8de202e182 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Request method failure captured: Aug 31 10:04:09.394180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: DELETE /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c HTTP/1.1 Aug 31 10:04:09.394180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 10:04:09.394180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 10:04:09.394180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 10:04:09.394180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 10:04:09.394180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 10:04:09.394180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 10:04:09.394180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 10:04:09.394180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 10:04:09.394180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDzA7RlgTqPbJ9x6G0d-icAmjdYoPScrNsrptUHwqdSDU1jyZjMduoMif0Yt1IPs0AW80HY2woB2gsC1-lK-cDpj7S0ZbQD96sNUp_78FGLaQTbAH1oaAb119vxMKAGYTUbI2NFyXAVZ1QC9EzH4PsDkEWeDAfeeTiE6hZBrrVlf2rU8 Aug 31 10:04:09.394180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 10:04:09.394180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 10:04:09.394180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 10:04:09.394180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 10:04:09.394180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 10:04:09.394180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 10:04:09.394180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 10:04:09.394180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: a68bf51dcd404f559e9ae2efeb185712 Aug 31 10:04:09.394180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2121567059 Aug 31 10:04:09.394180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 10:04:09.394180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 10:04:09.395866 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a68bf51dcd404f559e9ae2efeb185712"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a68bf51dcd404f559e9ae2efeb185712"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a68bf51dcd404f559e9ae2efeb185712"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a68bf51dcd404f559e9ae2efeb185712"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 10:04:09.395866 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2121567059 Aug 31 10:04:09.395866 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: a68bf51dcd404f559e9ae2efeb185712 Aug 31 10:04:09.395866 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2121567059 Aug 31 10:04:09.395866 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-AttachVolumeShelveTestJSON-2121567059-project Aug 31 10:04:09.395866 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 10:04:09.395866 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 10:04:09.395866 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: 6dc6f70f3b1b40d9be1f9d01da0de1f1 Aug 31 10:04:09.395866 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2121567059-project Aug 31 10:04:09.395866 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 10:04:09.395866 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Instance f34e6a94-72da-4a22-bab7-c5edbaae687c could not be found. Aug 31 10:04:09.395866 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': 'f34e6a94-72da-4a22-bab7-c5edbaae687c'} Aug 31 10:04:09.396786 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:04:09.396786 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:04:09.396786 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:04:09.396786 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:04:09.396786 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:04:09.396786 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:04:09.396786 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:04:09.396786 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:04:09.396786 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:04:09.396786 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:04:09.396786 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f34e6a94-72da-4a22-bab7-c5edbaae687c could not be found. Aug 31 10:04:09.396786 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:04:09.396786 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:04:09.396786 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:04:09.396786 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:04:09.396786 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:04:09.396786 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:04:09.396786 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:04:09.396786 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:04:09.396786 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:04:09.398561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:04:09.398561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 10:04:09.398561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 10:04:09.398561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 10:04:09.398561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 10:04:09.398561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:04:09.398561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:04:09.398561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:04:09.398561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:04:09.398561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f34e6a94-72da-4a22-bab7-c5edbaae687c could not be found. Aug 31 10:04:09.398561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:04:09.398561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:04:09.398561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:04:09.398561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:04:09.398561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:04:09.398561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:04:09.398561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:04:09.398561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:04:09.398561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f34e6a94-72da-4a22-bab7-c5edbaae687c could not be found. Aug 31 10:04:09.398561 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:04:09.400058 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-cb6f58ad-37e6-43aa-9a1c-ae8de202e182 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Returning 404 to user: Instance f34e6a94-72da-4a22-bab7-c5edbaae687c could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:04:09.400058 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-cb6f58ad-37e6-43aa-9a1c-ae8de202e182 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 404 len: 111 microversion: 2.20 time: 0.030069 Aug 31 10:04:09.400058 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 565/1113] 10.222.0.13 () {60 vars in 1280 bytes} [Wed Aug 31 10:04:09 2022] DELETE /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 10:04:09.404595 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-81f0b700-a6f1-41ce-8ed6-2f61b595c63e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:04:09.405325 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-81f0b700-a6f1-41ce-8ed6-2f61b595c63e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: f34e6a94-72da-4a22-bab7-c5edbaae687c] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:04:09.412002 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-81f0b700-a6f1-41ce-8ed6-2f61b595c63e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:04:09.412481 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-81f0b700-a6f1-41ce-8ed6-2f61b595c63e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:04:09.412908 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-81f0b700-a6f1-41ce-8ed6-2f61b595c63e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:04:09.413631 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-81f0b700-a6f1-41ce-8ed6-2f61b595c63e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:04:09.414081 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-81f0b700-a6f1-41ce-8ed6-2f61b595c63e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:04:09.414500 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-81f0b700-a6f1-41ce-8ed6-2f61b595c63e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:04:09.428428 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.wsgi [None req-81f0b700-a6f1-41ce-8ed6-2f61b595c63e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] HTTP exception thrown: Instance f34e6a94-72da-4a22-bab7-c5edbaae687c could not be found. Aug 31 10:04:09.430137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-81f0b700-a6f1-41ce-8ed6-2f61b595c63e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Request method failure captured: Aug 31 10:04:09.430137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: request: GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c HTTP/1.1 Aug 31 10:04:09.430137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept: application/json Aug 31 10:04:09.430137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept-Encoding: identity Aug 31 10:04:09.430137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Connection: close Aug 31 10:04:09.430137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Length: 0 Aug 31 10:04:09.430137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Type: application/json Aug 31 10:04:09.430137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Host: 10.222.0.13 Aug 31 10:04:09.430137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Openstack-System-Scope: None Aug 31 10:04:09.430137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: User-Agent: python-urllib3/1.26.12 Aug 31 10:04:09.430137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Auth-Token: gAAAAABjDzA7RlgTqPbJ9x6G0d-icAmjdYoPScrNsrptUHwqdSDU1jyZjMduoMif0Yt1IPs0AW80HY2woB2gsC1-lK-cDpj7S0ZbQD96sNUp_78FGLaQTbAH1oaAb119vxMKAGYTUbI2NFyXAVZ1QC9EzH4PsDkEWeDAfeeTiE6hZBrrVlf2rU8 Aug 31 10:04:09.430137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Id: None Aug 31 10:04:09.430137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Name: None Aug 31 10:04:09.430137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Identity-Status: Confirmed Aug 31 10:04:09.430137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Is-Admin-Project: True Aug 31 10:04:09.430137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 10:04:09.430137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Id: default Aug 31 10:04:09.430137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Name: Default Aug 31 10:04:09.430137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Id: a68bf51dcd404f559e9ae2efeb185712 Aug 31 10:04:09.430137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2121567059 Aug 31 10:04:09.430137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Role: member,reader Aug 31 10:04:09.430137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Roles: member,reader Aug 31 10:04:09.432478 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a68bf51dcd404f559e9ae2efeb185712"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a68bf51dcd404f559e9ae2efeb185712"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a68bf51dcd404f559e9ae2efeb185712"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a68bf51dcd404f559e9ae2efeb185712"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 10:04:09.432478 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2121567059 Aug 31 10:04:09.432478 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Id: a68bf51dcd404f559e9ae2efeb185712 Aug 31 10:04:09.432478 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2121567059 Aug 31 10:04:09.432478 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User: tempest-AttachVolumeShelveTestJSON-2121567059-project Aug 31 10:04:09.432478 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Id: default Aug 31 10:04:09.432478 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Name: Default Aug 31 10:04:09.432478 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Id: 6dc6f70f3b1b40d9be1f9d01da0de1f1 Aug 31 10:04:09.432478 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2121567059-project Aug 31 10:04:09.432478 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: method: > Aug 31 10:04:09.432478 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: exception: Instance f34e6a94-72da-4a22-bab7-c5edbaae687c could not be found. Aug 31 10:04:09.432478 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: action_args: {'id': 'f34e6a94-72da-4a22-bab7-c5edbaae687c'} Aug 31 10:04:09.433429 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:04:09.433429 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:04:09.433429 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:04:09.433429 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:04:09.433429 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:04:09.433429 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:04:09.433429 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:04:09.433429 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:04:09.433429 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:04:09.433429 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:04:09.433429 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f34e6a94-72da-4a22-bab7-c5edbaae687c could not be found. Aug 31 10:04:09.433429 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 10:04:09.433429 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:04:09.433429 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 10:04:09.433429 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:04:09.433429 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:04:09.433429 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:04:09.433429 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:04:09.433429 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:04:09.433429 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:04:09.434948 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:04:09.434948 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:04:09.434948 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:04:09.434948 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:04:09.434948 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:04:09.434948 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:04:09.434948 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:04:09.434948 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f34e6a94-72da-4a22-bab7-c5edbaae687c could not be found. Aug 31 10:04:09.434948 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 10:04:09.434948 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:04:09.434948 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 10:04:09.434948 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:04:09.434948 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:04:09.434948 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:04:09.434948 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:04:09.434948 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:04:09.434948 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f34e6a94-72da-4a22-bab7-c5edbaae687c could not be found. Aug 31 10:04:09.434948 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 10:04:09.437222 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-81f0b700-a6f1-41ce-8ed6-2f61b595c63e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Returning 404 to user: Instance f34e6a94-72da-4a22-bab7-c5edbaae687c could not be found. {{(pid=127171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:04:09.437222 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-81f0b700-a6f1-41ce-8ed6-2f61b595c63e tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c" status: 404 len: 111 microversion: 2.20 time: 0.031960 Aug 31 10:04:09.437222 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 549/1114] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:04:09 2022] GET /compute/v2.1/servers/f34e6a94-72da-4a22-bab7-c5edbaae687c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 10:04:10.574320 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-baaec69d-844f-497b-bb44-4ff86f0a4d42 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:04:10.576122 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-baaec69d-844f-497b-bb44-4ff86f0a4d42 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:04:10.581259 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-baaec69d-844f-497b-bb44-4ff86f0a4d42 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:04:10.581769 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-baaec69d-844f-497b-bb44-4ff86f0a4d42 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:04:10.582203 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-baaec69d-844f-497b-bb44-4ff86f0a4d42 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:04:10.582924 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-baaec69d-844f-497b-bb44-4ff86f0a4d42 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:04:10.583346 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-baaec69d-844f-497b-bb44-4ff86f0a4d42 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:04:10.583765 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-baaec69d-844f-497b-bb44-4ff86f0a4d42 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:04:10.599978 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-baaec69d-844f-497b-bb44-4ff86f0a4d42 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] HTTP exception thrown: Instance b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 could not be found. Aug 31 10:04:10.601581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-baaec69d-844f-497b-bb44-4ff86f0a4d42 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Request method failure captured: Aug 31 10:04:10.601581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: DELETE /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 HTTP/1.1 Aug 31 10:04:10.601581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 10:04:10.601581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 10:04:10.601581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 10:04:10.601581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 10:04:10.601581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 10:04:10.601581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 10:04:10.601581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 10:04:10.601581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 10:04:10.601581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDzA7RlgTqPbJ9x6G0d-icAmjdYoPScrNsrptUHwqdSDU1jyZjMduoMif0Yt1IPs0AW80HY2woB2gsC1-lK-cDpj7S0ZbQD96sNUp_78FGLaQTbAH1oaAb119vxMKAGYTUbI2NFyXAVZ1QC9EzH4PsDkEWeDAfeeTiE6hZBrrVlf2rU8 Aug 31 10:04:10.601581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 10:04:10.601581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 10:04:10.601581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 10:04:10.601581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 10:04:10.601581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 10:04:10.601581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 10:04:10.601581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 10:04:10.601581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: a68bf51dcd404f559e9ae2efeb185712 Aug 31 10:04:10.601581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2121567059 Aug 31 10:04:10.601581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 10:04:10.601581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 10:04:10.603326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a68bf51dcd404f559e9ae2efeb185712"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a68bf51dcd404f559e9ae2efeb185712"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a68bf51dcd404f559e9ae2efeb185712"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a68bf51dcd404f559e9ae2efeb185712"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 10:04:10.603326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2121567059 Aug 31 10:04:10.603326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: a68bf51dcd404f559e9ae2efeb185712 Aug 31 10:04:10.603326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2121567059 Aug 31 10:04:10.603326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-AttachVolumeShelveTestJSON-2121567059-project Aug 31 10:04:10.603326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 10:04:10.603326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 10:04:10.603326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: 6dc6f70f3b1b40d9be1f9d01da0de1f1 Aug 31 10:04:10.603326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2121567059-project Aug 31 10:04:10.603326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 10:04:10.603326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Instance b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 could not be found. Aug 31 10:04:10.603326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': 'b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9'} Aug 31 10:04:10.604227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:04:10.604227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:04:10.604227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:04:10.604227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:04:10.604227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:04:10.604227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:04:10.604227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:04:10.604227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:04:10.604227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:04:10.604227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:04:10.604227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 could not be found. Aug 31 10:04:10.604227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:04:10.604227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:04:10.604227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:04:10.604227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:04:10.604227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:04:10.604227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:04:10.604227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:04:10.604227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:04:10.604227 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:04:10.606586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:04:10.606586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 10:04:10.606586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 10:04:10.606586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 10:04:10.606586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 10:04:10.606586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:04:10.606586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:04:10.606586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:04:10.606586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:04:10.606586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 could not be found. Aug 31 10:04:10.606586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:04:10.606586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:04:10.606586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:04:10.606586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:04:10.606586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:04:10.606586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:04:10.606586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:04:10.606586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:04:10.606586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 could not be found. Aug 31 10:04:10.606586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:04:10.608055 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-baaec69d-844f-497b-bb44-4ff86f0a4d42 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Returning 404 to user: Instance b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:04:10.608055 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-baaec69d-844f-497b-bb44-4ff86f0a4d42 tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 404 len: 111 microversion: 2.20 time: 0.032977 Aug 31 10:04:10.608055 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 566/1115] 10.222.0.13 () {60 vars in 1280 bytes} [Wed Aug 31 10:04:10 2022] DELETE /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 10:04:10.612518 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-739547b2-0b07-4e09-a85d-1d92e5aed99a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:04:10.613141 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-739547b2-0b07-4e09-a85d-1d92e5aed99a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] [instance: b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:04:10.619733 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-739547b2-0b07-4e09-a85d-1d92e5aed99a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:04:10.620276 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-739547b2-0b07-4e09-a85d-1d92e5aed99a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:04:10.621070 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-739547b2-0b07-4e09-a85d-1d92e5aed99a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:04:10.621809 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-739547b2-0b07-4e09-a85d-1d92e5aed99a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:04:10.622276 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-739547b2-0b07-4e09-a85d-1d92e5aed99a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:04:10.622840 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-739547b2-0b07-4e09-a85d-1d92e5aed99a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:04:10.636501 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.wsgi [None req-739547b2-0b07-4e09-a85d-1d92e5aed99a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] HTTP exception thrown: Instance b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 could not be found. Aug 31 10:04:10.638090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-739547b2-0b07-4e09-a85d-1d92e5aed99a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Request method failure captured: Aug 31 10:04:10.638090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: request: GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 HTTP/1.1 Aug 31 10:04:10.638090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept: application/json Aug 31 10:04:10.638090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Accept-Encoding: identity Aug 31 10:04:10.638090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Connection: close Aug 31 10:04:10.638090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Length: 0 Aug 31 10:04:10.638090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Content-Type: application/json Aug 31 10:04:10.638090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Host: 10.222.0.13 Aug 31 10:04:10.638090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Openstack-System-Scope: None Aug 31 10:04:10.638090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: User-Agent: python-urllib3/1.26.12 Aug 31 10:04:10.638090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Auth-Token: gAAAAABjDzA7RlgTqPbJ9x6G0d-icAmjdYoPScrNsrptUHwqdSDU1jyZjMduoMif0Yt1IPs0AW80HY2woB2gsC1-lK-cDpj7S0ZbQD96sNUp_78FGLaQTbAH1oaAb119vxMKAGYTUbI2NFyXAVZ1QC9EzH4PsDkEWeDAfeeTiE6hZBrrVlf2rU8 Aug 31 10:04:10.638090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Id: None Aug 31 10:04:10.638090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Domain-Name: None Aug 31 10:04:10.638090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Identity-Status: Confirmed Aug 31 10:04:10.638090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Is-Admin-Project: True Aug 31 10:04:10.638090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 10:04:10.638090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Id: default Aug 31 10:04:10.638090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Domain-Name: Default Aug 31 10:04:10.638090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Id: a68bf51dcd404f559e9ae2efeb185712 Aug 31 10:04:10.638090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2121567059 Aug 31 10:04:10.638090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Role: member,reader Aug 31 10:04:10.638090 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Roles: member,reader Aug 31 10:04:10.639764 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a68bf51dcd404f559e9ae2efeb185712"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a68bf51dcd404f559e9ae2efeb185712"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a68bf51dcd404f559e9ae2efeb185712"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a68bf51dcd404f559e9ae2efeb185712"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 10:04:10.639764 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2121567059 Aug 31 10:04:10.639764 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Id: a68bf51dcd404f559e9ae2efeb185712 Aug 31 10:04:10.639764 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2121567059 Aug 31 10:04:10.639764 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User: tempest-AttachVolumeShelveTestJSON-2121567059-project Aug 31 10:04:10.639764 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Id: default Aug 31 10:04:10.639764 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Domain-Name: Default Aug 31 10:04:10.639764 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Id: 6dc6f70f3b1b40d9be1f9d01da0de1f1 Aug 31 10:04:10.639764 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2121567059-project Aug 31 10:04:10.639764 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: method: > Aug 31 10:04:10.639764 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: exception: Instance b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 could not be found. Aug 31 10:04:10.639764 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: action_args: {'id': 'b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9'} Aug 31 10:04:10.640760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:04:10.640760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:04:10.640760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:04:10.640760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:04:10.640760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:04:10.640760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:04:10.640760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:04:10.640760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:04:10.640760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:04:10.640760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:04:10.640760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 could not be found. Aug 31 10:04:10.640760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 10:04:10.640760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:04:10.640760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 10:04:10.640760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:04:10.640760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:04:10.640760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:04:10.640760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:04:10.640760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:04:10.640760 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:04:10.642304 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:04:10.642304 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:04:10.642304 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:04:10.642304 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:04:10.642304 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:04:10.642304 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:04:10.642304 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:04:10.642304 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 could not be found. Aug 31 10:04:10.642304 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 10:04:10.642304 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:04:10.642304 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 10:04:10.642304 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:04:10.642304 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:04:10.642304 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:04:10.642304 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:04:10.642304 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:04:10.642304 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 could not be found. Aug 31 10:04:10.642304 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: ERROR nova.api.openstack.wsgi Aug 31 10:04:10.643658 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-739547b2-0b07-4e09-a85d-1d92e5aed99a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] Returning 404 to user: Instance b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 could not be found. {{(pid=127171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:04:10.643658 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-739547b2-0b07-4e09-a85d-1d92e5aed99a tempest-AttachVolumeShelveTestJSON-2121567059 tempest-AttachVolumeShelveTestJSON-2121567059-project] 10.222.0.13 "GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9" status: 404 len: 111 microversion: 2.20 time: 0.031274 Aug 31 10:04:10.643658 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 550/1116] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 31 10:04:10 2022] GET /compute/v2.1/servers/b66a69ff-2317-4dbe-b580-d6c7dc5f4cb9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 10:06:44.726253 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR oslo.messaging._drivers.impl_rabbit [-] [de6ada37-cd1c-400a-ae73-9d2d76b9c7aa] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 10:06:44.727149 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 10:06:44.727293 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Wed Aug 31 10:06:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.13) !!! Aug 31 10:06:44.729019 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=12 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:06:44.729781 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=24 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:06:44.730656 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 10:06:44.730776 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Wed Aug 31 10:06:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.13) !!! Aug 31 10:06:44.742692 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-9f0238ba-c559-400e-b5ae-96c4a9570f39 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Action: 'create', calling method: .version_select at 0x7f5503de9a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-786685181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOJ7Ajxe2cFHcr17FTcEmQEtrxEf7tU3ZGapiPhK5/RtNRONZ0CYlqWZxeJbR9pCqsTSuQmRb4Wu1yBWByDK3ZYbBO/eZptDkK+JvXtwcUzDAxAeKKWpez1AgCAGEFcjg=="}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:06:44.761226 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-9f0238ba-c559-400e-b5ae-96c4a9570f39 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Getting quotas for project 12a138e95d884fdaa8bb8653b151a546. Resources: {'key_pairs'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:06:44.765719 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.quota [None req-9f0238ba-c559-400e-b5ae-96c4a9570f39 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Getting quotas for user 2e8d67de6305464a982b7ad155a1ecca and project 12a138e95d884fdaa8bb8653b151a546. Resources: {'key_pairs'} {{(pid=127170) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:06:44.790477 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-9f0238ba-c559-400e-b5ae-96c4a9570f39 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.066043 Aug 31 10:06:44.791080 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 567/1117] 10.222.0.13 () {60 vars in 1159 bytes} [Wed Aug 31 10:06:44 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:06:44.839678 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:06:44.840423 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:06:44.841927 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 10:06:44.842102 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Wed Aug 31 10:06:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.13) !!! Aug 31 10:06:44.843923 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 10:06:44.844065 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Wed Aug 31 10:06:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.13) !!! Aug 31 10:06:44.849153 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-ebc9407b-47db-4a3b-b7b9-ebffe2df3a84 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-242431374", "imageRef": "92dcd881-e049-4f77-bfe7-41a1a63944cb", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-786685181", "networks": [{"uuid": "e59fd3c4-967e-4768-99cd-ea919e7cf128"}]}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:06:44.908693 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.network.neutron [None req-ebc9407b-47db-4a3b-b7b9-ebffe2df3a84 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] validate_networks() for [('e59fd3c4-967e-4768-99cd-ea919e7cf128', None, None, None, None, None)] {{(pid=127171) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 10:06:45.380144 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-ebc9407b-47db-4a3b-b7b9-ebffe2df3a84 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Flavor limits 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 10:06:45.380570 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-ebc9407b-47db-4a3b-b7b9-ebffe2df3a84 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Image limits 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 10:06:45.381045 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-ebc9407b-47db-4a3b-b7b9-ebffe2df3a84 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Flavor pref 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 10:06:45.381484 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-ebc9407b-47db-4a3b-b7b9-ebffe2df3a84 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Image pref 0:0:0 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 10:06:45.381901 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.virt.hardware [None req-ebc9407b-47db-4a3b-b7b9-ebffe2df3a84 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 10:06:45.391606 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ebc9407b-47db-4a3b-b7b9-ebffe2df3a84 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:45.392091 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ebc9407b-47db-4a3b-b7b9-ebffe2df3a84 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:45.392527 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ebc9407b-47db-4a3b-b7b9-ebffe2df3a84 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:45.393255 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ebc9407b-47db-4a3b-b7b9-ebffe2df3a84 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:45.393751 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ebc9407b-47db-4a3b-b7b9-ebffe2df3a84 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:45.394176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-ebc9407b-47db-4a3b-b7b9-ebffe2df3a84 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:45.412202 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-ebc9407b-47db-4a3b-b7b9-ebffe2df3a84 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Getting quotas for project 12a138e95d884fdaa8bb8653b151a546. Resources: {'ram', 'instances', 'cores'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:06:45.416207 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.quota [None req-ebc9407b-47db-4a3b-b7b9-ebffe2df3a84 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Getting quotas for user 2e8d67de6305464a982b7ad155a1ecca and project 12a138e95d884fdaa8bb8653b151a546. Resources: {'ram', 'instances', 'cores'} {{(pid=127171) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:06:45.428240 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-ebc9407b-47db-4a3b-b7b9-ebffe2df3a84 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Going to run 1 instances... {{(pid=127171) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 10:06:45.430522 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-ebc9407b-47db-4a3b-b7b9-ebffe2df3a84 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92dcd881-e049-4f77-bfe7-41a1a63944cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 10:06:45.479731 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-ebc9407b-47db-4a3b-b7b9-ebffe2df3a84 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641896 Aug 31 10:06:45.480383 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 551/1118] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 31 10:06:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 10:06:45.492425 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-9d39d597-75ee-4b4f-98b9-bfbefa9cd16c tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:06:45.493127 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-9d39d597-75ee-4b4f-98b9-bfbefa9cd16c tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:06:45.549056 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-9d39d597-75ee-4b4f-98b9-bfbefa9cd16c tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:06:45.556054 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-9d39d597-75ee-4b4f-98b9-bfbefa9cd16c tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1257 microversion: 2.1 time: 0.067667 Aug 31 10:06:45.556615 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 568/1119] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:06:45 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:06:46.576297 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-3249655a-d3f5-47a4-ad60-985f634fa3e4 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:06:46.577093 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-3249655a-d3f5-47a4-ad60-985f634fa3e4 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:06:46.583960 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3249655a-d3f5-47a4-ad60-985f634fa3e4 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:46.584456 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3249655a-d3f5-47a4-ad60-985f634fa3e4 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:46.584895 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3249655a-d3f5-47a4-ad60-985f634fa3e4 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:46.585632 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3249655a-d3f5-47a4-ad60-985f634fa3e4 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:46.586095 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3249655a-d3f5-47a4-ad60-985f634fa3e4 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:46.586521 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-3249655a-d3f5-47a4-ad60-985f634fa3e4 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:46.652457 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-3249655a-d3f5-47a4-ad60-985f634fa3e4 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:06:46.660835 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-3249655a-d3f5-47a4-ad60-985f634fa3e4 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1309 microversion: 2.1 time: 0.088562 Aug 31 10:06:46.661461 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 552/1120] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:06:46 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1309 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:06:47.690460 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-be3f88dd-0ca1-4cf2-8e93-0725ab4afe42 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:06:47.692491 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-be3f88dd-0ca1-4cf2-8e93-0725ab4afe42 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:06:47.707870 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-be3f88dd-0ca1-4cf2-8e93-0725ab4afe42 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:47.708939 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-be3f88dd-0ca1-4cf2-8e93-0725ab4afe42 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:47.709660 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-be3f88dd-0ca1-4cf2-8e93-0725ab4afe42 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:47.710447 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-be3f88dd-0ca1-4cf2-8e93-0725ab4afe42 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:47.710968 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-be3f88dd-0ca1-4cf2-8e93-0725ab4afe42 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:47.711725 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-be3f88dd-0ca1-4cf2-8e93-0725ab4afe42 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:47.717364 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO oslo.messaging._drivers.impl_rabbit [-] [de6ada37-cd1c-400a-ae73-9d2d76b9c7aa] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50940. Aug 31 10:06:47.893747 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-be3f88dd-0ca1-4cf2-8e93-0725ab4afe42 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:06:47.902174 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-be3f88dd-0ca1-4cf2-8e93-0725ab4afe42 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1357 microversion: 2.1 time: 0.222727 Aug 31 10:06:47.903573 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 569/1121] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:06:47 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:06:48.924800 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-0c951dcf-ffb1-4877-89eb-36b4af01aafd tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:06:48.925494 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-0c951dcf-ffb1-4877-89eb-36b4af01aafd tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:06:48.932175 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0c951dcf-ffb1-4877-89eb-36b4af01aafd tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:48.932785 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0c951dcf-ffb1-4877-89eb-36b4af01aafd tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:48.933403 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0c951dcf-ffb1-4877-89eb-36b4af01aafd tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:48.934271 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0c951dcf-ffb1-4877-89eb-36b4af01aafd tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:48.934858 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0c951dcf-ffb1-4877-89eb-36b4af01aafd tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:48.935309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-0c951dcf-ffb1-4877-89eb-36b4af01aafd tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:49.089198 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-0c951dcf-ffb1-4877-89eb-36b4af01aafd tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:06:49.097309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-0c951dcf-ffb1-4877-89eb-36b4af01aafd tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1357 microversion: 2.1 time: 0.176910 Aug 31 10:06:49.097938 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 553/1122] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:06:48 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:06:50.120213 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-9b202ee9-c580-4f98-8b99-0bc23934ef44 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:06:50.120748 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-9b202ee9-c580-4f98-8b99-0bc23934ef44 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:06:50.127628 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9b202ee9-c580-4f98-8b99-0bc23934ef44 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:50.128114 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9b202ee9-c580-4f98-8b99-0bc23934ef44 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:50.128544 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9b202ee9-c580-4f98-8b99-0bc23934ef44 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:50.129476 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9b202ee9-c580-4f98-8b99-0bc23934ef44 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:50.130102 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9b202ee9-c580-4f98-8b99-0bc23934ef44 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:50.130518 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9b202ee9-c580-4f98-8b99-0bc23934ef44 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:50.268225 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-9b202ee9-c580-4f98-8b99-0bc23934ef44 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:06:50.276424 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-9b202ee9-c580-4f98-8b99-0bc23934ef44 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1357 microversion: 2.1 time: 0.160053 Aug 31 10:06:50.277703 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 570/1123] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:06:50 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:06:51.298829 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-38d8d51e-dab6-4a70-b231-cf41a6c742dc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:06:51.299555 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-38d8d51e-dab6-4a70-b231-cf41a6c742dc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:06:51.306003 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38d8d51e-dab6-4a70-b231-cf41a6c742dc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:51.306486 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38d8d51e-dab6-4a70-b231-cf41a6c742dc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:51.306931 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38d8d51e-dab6-4a70-b231-cf41a6c742dc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:51.307612 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38d8d51e-dab6-4a70-b231-cf41a6c742dc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:51.308064 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38d8d51e-dab6-4a70-b231-cf41a6c742dc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:51.308482 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-38d8d51e-dab6-4a70-b231-cf41a6c742dc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:51.450029 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-38d8d51e-dab6-4a70-b231-cf41a6c742dc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:06:51.458548 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-38d8d51e-dab6-4a70-b231-cf41a6c742dc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1357 microversion: 2.1 time: 0.163665 Aug 31 10:06:51.459121 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 554/1124] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:06:51 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:06:52.480183 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-9b9a6b9b-b264-4943-b2e4-a426ba1f1510 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:06:52.480785 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-9b9a6b9b-b264-4943-b2e4-a426ba1f1510 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:06:52.487753 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9b9a6b9b-b264-4943-b2e4-a426ba1f1510 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:52.488230 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9b9a6b9b-b264-4943-b2e4-a426ba1f1510 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:52.488654 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9b9a6b9b-b264-4943-b2e4-a426ba1f1510 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:52.489671 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9b9a6b9b-b264-4943-b2e4-a426ba1f1510 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:52.490434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9b9a6b9b-b264-4943-b2e4-a426ba1f1510 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:52.491205 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9b9a6b9b-b264-4943-b2e4-a426ba1f1510 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:52.663363 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-9b9a6b9b-b264-4943-b2e4-a426ba1f1510 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:06:52.673013 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-9b9a6b9b-b264-4943-b2e4-a426ba1f1510 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1357 microversion: 2.1 time: 0.196606 Aug 31 10:06:52.687165 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 571/1125] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:06:52 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1357 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:06:53.700166 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-25d1701a-8bcf-41a6-9aa9-23e4009b00b6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:06:53.701229 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-25d1701a-8bcf-41a6-9aa9-23e4009b00b6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:06:53.710262 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-25d1701a-8bcf-41a6-9aa9-23e4009b00b6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:53.710747 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-25d1701a-8bcf-41a6-9aa9-23e4009b00b6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:53.711176 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-25d1701a-8bcf-41a6-9aa9-23e4009b00b6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:53.711866 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-25d1701a-8bcf-41a6-9aa9-23e4009b00b6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:53.712309 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-25d1701a-8bcf-41a6-9aa9-23e4009b00b6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:53.712725 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-25d1701a-8bcf-41a6-9aa9-23e4009b00b6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:53.852791 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-25d1701a-8bcf-41a6-9aa9-23e4009b00b6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:06:53.861375 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-25d1701a-8bcf-41a6-9aa9-23e4009b00b6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1357 microversion: 2.1 time: 0.169660 Aug 31 10:06:53.862565 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 555/1126] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:06:53 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:06:54.884835 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b2e2ff44-fa5e-4c42-9e7b-649e1d6202ed tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:06:54.885470 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b2e2ff44-fa5e-4c42-9e7b-649e1d6202ed tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:06:54.893129 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b2e2ff44-fa5e-4c42-9e7b-649e1d6202ed tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:54.893645 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b2e2ff44-fa5e-4c42-9e7b-649e1d6202ed tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:54.894080 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b2e2ff44-fa5e-4c42-9e7b-649e1d6202ed tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:54.894771 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b2e2ff44-fa5e-4c42-9e7b-649e1d6202ed tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:54.895218 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b2e2ff44-fa5e-4c42-9e7b-649e1d6202ed tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:54.895641 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b2e2ff44-fa5e-4c42-9e7b-649e1d6202ed tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:55.031235 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b2e2ff44-fa5e-4c42-9e7b-649e1d6202ed tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:06:55.038940 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b2e2ff44-fa5e-4c42-9e7b-649e1d6202ed tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1357 microversion: 2.1 time: 0.158085 Aug 31 10:06:55.039547 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 572/1127] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:06:54 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:06:56.060617 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-512224b3-5089-481f-9198-646d073e5d15 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:06:56.061875 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-512224b3-5089-481f-9198-646d073e5d15 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:06:56.064206 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=2 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:06:56.064985 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell0:SELECT=6 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:06:56.071238 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-512224b3-5089-481f-9198-646d073e5d15 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:56.071722 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-512224b3-5089-481f-9198-646d073e5d15 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:56.072150 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-512224b3-5089-481f-9198-646d073e5d15 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:56.072837 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-512224b3-5089-481f-9198-646d073e5d15 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:56.073282 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-512224b3-5089-481f-9198-646d073e5d15 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:56.073724 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-512224b3-5089-481f-9198-646d073e5d15 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:56.206259 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-512224b3-5089-481f-9198-646d073e5d15 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:06:56.213914 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-512224b3-5089-481f-9198-646d073e5d15 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1357 microversion: 2.1 time: 0.157840 Aug 31 10:06:56.214484 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 556/1128] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:06:56 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:06:57.235783 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-a5283915-d4e9-4ee7-8b24-aa8fa9ec12df tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:06:57.236396 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-a5283915-d4e9-4ee7-8b24-aa8fa9ec12df tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:06:57.238267 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=6 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:06:57.243937 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a5283915-d4e9-4ee7-8b24-aa8fa9ec12df tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:57.244416 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a5283915-d4e9-4ee7-8b24-aa8fa9ec12df tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:57.244845 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a5283915-d4e9-4ee7-8b24-aa8fa9ec12df tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:57.245572 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a5283915-d4e9-4ee7-8b24-aa8fa9ec12df tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:57.246020 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a5283915-d4e9-4ee7-8b24-aa8fa9ec12df tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:57.246434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-a5283915-d4e9-4ee7-8b24-aa8fa9ec12df tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:57.377017 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-a5283915-d4e9-4ee7-8b24-aa8fa9ec12df tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:06:57.386838 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-a5283915-d4e9-4ee7-8b24-aa8fa9ec12df tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1357 microversion: 2.1 time: 0.155431 Aug 31 10:06:57.387454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 573/1129] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:06:57 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:06:58.154134 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-a81775be-b254-492e-b83b-2ed71da71921 req-3558a85c-cb86-4171-b619-8ca631ce3707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2a1fcb7-e956-40e3-8a46-50b8e539f892", "tag": "c8a86a3c-f0ce-49da-85d1-df62974790f8"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:06:58.164105 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-a81775be-b254-492e-b83b-2ed71da71921 req-3558a85c-cb86-4171-b619-8ca631ce3707 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:58.164582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-a81775be-b254-492e-b83b-2ed71da71921 req-3558a85c-cb86-4171-b619-8ca631ce3707 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:58.165008 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-a81775be-b254-492e-b83b-2ed71da71921 req-3558a85c-cb86-4171-b619-8ca631ce3707 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:58.176451 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-a81775be-b254-492e-b83b-2ed71da71921 req-3558a85c-cb86-4171-b619-8ca631ce3707 service nova] Creating event network-changed:c8a86a3c-f0ce-49da-85d1-df62974790f8 for instance d2a1fcb7-e956-40e3-8a46-50b8e539f892 on hv-cinder-84496 Aug 31 10:06:58.182386 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-a81775be-b254-492e-b83b-2ed71da71921 req-3558a85c-cb86-4171-b619-8ca631ce3707 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184997 Aug 31 10:06:58.182988 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 557/1130] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 10:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:06:58.409408 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-9c68bb97-3d4e-4fc6-84dd-8c5a4bf5bafc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:06:58.410009 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-9c68bb97-3d4e-4fc6-84dd-8c5a4bf5bafc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:06:58.416682 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9c68bb97-3d4e-4fc6-84dd-8c5a4bf5bafc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:58.417169 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9c68bb97-3d4e-4fc6-84dd-8c5a4bf5bafc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:58.417633 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9c68bb97-3d4e-4fc6-84dd-8c5a4bf5bafc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:58.418358 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9c68bb97-3d4e-4fc6-84dd-8c5a4bf5bafc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:58.418799 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9c68bb97-3d4e-4fc6-84dd-8c5a4bf5bafc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:58.419224 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-9c68bb97-3d4e-4fc6-84dd-8c5a4bf5bafc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:58.809212 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-9c68bb97-3d4e-4fc6-84dd-8c5a4bf5bafc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:06:58.821168 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-9c68bb97-3d4e-4fc6-84dd-8c5a4bf5bafc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1357 microversion: 2.1 time: 0.416338 Aug 31 10:06:58.822640 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 574/1131] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:06:58 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1357 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:06:59.845790 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-5d829a7e-b35a-4df2-b078-447ad05c548d tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:06:59.846442 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-5d829a7e-b35a-4df2-b078-447ad05c548d tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:06:59.852656 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5d829a7e-b35a-4df2-b078-447ad05c548d tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:59.853131 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5d829a7e-b35a-4df2-b078-447ad05c548d tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:59.853591 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5d829a7e-b35a-4df2-b078-447ad05c548d tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:59.854283 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5d829a7e-b35a-4df2-b078-447ad05c548d tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:06:59.854731 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5d829a7e-b35a-4df2-b078-447ad05c548d tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:06:59.855149 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5d829a7e-b35a-4df2-b078-447ad05c548d tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:06:59.987040 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-5d829a7e-b35a-4df2-b078-447ad05c548d tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:06:59.994667 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-5d829a7e-b35a-4df2-b078-447ad05c548d tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1357 microversion: 2.1 time: 0.154648 Aug 31 10:06:59.995234 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 558/1132] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:06:59 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:07:01.015630 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-66eb625c-3810-476d-8b2d-a3f8ded9f2f9 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:07:01.016352 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-66eb625c-3810-476d-8b2d-a3f8ded9f2f9 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:07:01.022687 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-66eb625c-3810-476d-8b2d-a3f8ded9f2f9 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:01.023169 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-66eb625c-3810-476d-8b2d-a3f8ded9f2f9 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:01.023605 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-66eb625c-3810-476d-8b2d-a3f8ded9f2f9 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:01.024305 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-66eb625c-3810-476d-8b2d-a3f8ded9f2f9 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:01.024758 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-66eb625c-3810-476d-8b2d-a3f8ded9f2f9 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:01.025180 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-66eb625c-3810-476d-8b2d-a3f8ded9f2f9 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:01.259064 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-66eb625c-3810-476d-8b2d-a3f8ded9f2f9 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:07:01.267613 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-66eb625c-3810-476d-8b2d-a3f8ded9f2f9 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1357 microversion: 2.1 time: 0.255933 Aug 31 10:07:01.268189 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 575/1133] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:07:01 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1357 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:07:02.288083 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-7f000bd8-3bee-40f1-8778-8bddc7d17ec2 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:07:02.288635 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-7f000bd8-3bee-40f1-8778-8bddc7d17ec2 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:07:02.295022 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7f000bd8-3bee-40f1-8778-8bddc7d17ec2 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:02.296493 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7f000bd8-3bee-40f1-8778-8bddc7d17ec2 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:02.297067 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7f000bd8-3bee-40f1-8778-8bddc7d17ec2 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:02.297800 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7f000bd8-3bee-40f1-8778-8bddc7d17ec2 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:02.298295 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7f000bd8-3bee-40f1-8778-8bddc7d17ec2 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:02.298680 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-7f000bd8-3bee-40f1-8778-8bddc7d17ec2 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:02.431232 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-7f000bd8-3bee-40f1-8778-8bddc7d17ec2 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:07:02.439622 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-7f000bd8-3bee-40f1-8778-8bddc7d17ec2 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1357 microversion: 2.1 time: 0.155476 Aug 31 10:07:02.440201 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 559/1134] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:07:02 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:07:03.460301 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-3b26b463-96d5-4868-8b88-0f3a94529dbb tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:07:03.460901 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-3b26b463-96d5-4868-8b88-0f3a94529dbb tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:07:03.467931 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3b26b463-96d5-4868-8b88-0f3a94529dbb tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:03.468403 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3b26b463-96d5-4868-8b88-0f3a94529dbb tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:03.468826 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3b26b463-96d5-4868-8b88-0f3a94529dbb tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:03.469534 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3b26b463-96d5-4868-8b88-0f3a94529dbb tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:03.469976 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3b26b463-96d5-4868-8b88-0f3a94529dbb tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:03.470386 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-3b26b463-96d5-4868-8b88-0f3a94529dbb tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:03.599016 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-3b26b463-96d5-4868-8b88-0f3a94529dbb tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:07:03.606684 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-3b26b463-96d5-4868-8b88-0f3a94529dbb tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1357 microversion: 2.1 time: 0.150503 Aug 31 10:07:03.607242 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 576/1135] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:07:03 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:07:04.627639 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-d6e273d4-eeb8-4bab-80da-eae143b88d21 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:07:04.628310 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-d6e273d4-eeb8-4bab-80da-eae143b88d21 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:07:04.634780 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d6e273d4-eeb8-4bab-80da-eae143b88d21 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:04.635254 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d6e273d4-eeb8-4bab-80da-eae143b88d21 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:04.635680 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d6e273d4-eeb8-4bab-80da-eae143b88d21 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:04.636368 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d6e273d4-eeb8-4bab-80da-eae143b88d21 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:04.636813 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d6e273d4-eeb8-4bab-80da-eae143b88d21 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:04.637226 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d6e273d4-eeb8-4bab-80da-eae143b88d21 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:04.777436 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-d6e273d4-eeb8-4bab-80da-eae143b88d21 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:07:04.793845 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-d6e273d4-eeb8-4bab-80da-eae143b88d21 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1357 microversion: 2.1 time: 0.169976 Aug 31 10:07:04.794436 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 560/1136] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:07:04 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:07:04.851864 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-89dcc903-8b72-4238-998a-756ba02506e8 req-1e0c3678-2f07-4db3-b0e2-9bb88d95b7a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2a1fcb7-e956-40e3-8a46-50b8e539f892", "name": "network-vif-plugged", "status": "completed", "tag": "c8a86a3c-f0ce-49da-85d1-df62974790f8"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:07:04.861888 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-89dcc903-8b72-4238-998a-756ba02506e8 req-1e0c3678-2f07-4db3-b0e2-9bb88d95b7a1 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:04.862365 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-89dcc903-8b72-4238-998a-756ba02506e8 req-1e0c3678-2f07-4db3-b0e2-9bb88d95b7a1 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:04.862794 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-89dcc903-8b72-4238-998a-756ba02506e8 req-1e0c3678-2f07-4db3-b0e2-9bb88d95b7a1 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:04.874539 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-89dcc903-8b72-4238-998a-756ba02506e8 req-1e0c3678-2f07-4db3-b0e2-9bb88d95b7a1 service nova] Creating event network-vif-plugged:c8a86a3c-f0ce-49da-85d1-df62974790f8 for instance d2a1fcb7-e956-40e3-8a46-50b8e539f892 on hv-cinder-84496 Aug 31 10:07:04.880558 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-89dcc903-8b72-4238-998a-756ba02506e8 req-1e0c3678-2f07-4db3-b0e2-9bb88d95b7a1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097991 Aug 31 10:07:04.881068 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 577/1137] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 10:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:07:05.814771 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-71a77b3b-ae89-4654-81d3-1b3a90f107c5 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:07:05.815382 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-71a77b3b-ae89-4654-81d3-1b3a90f107c5 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:07:05.821992 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-71a77b3b-ae89-4654-81d3-1b3a90f107c5 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:05.822473 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-71a77b3b-ae89-4654-81d3-1b3a90f107c5 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:05.822902 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-71a77b3b-ae89-4654-81d3-1b3a90f107c5 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:05.823582 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-71a77b3b-ae89-4654-81d3-1b3a90f107c5 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:05.824027 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-71a77b3b-ae89-4654-81d3-1b3a90f107c5 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:05.824441 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-71a77b3b-ae89-4654-81d3-1b3a90f107c5 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:05.959672 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-71a77b3b-ae89-4654-81d3-1b3a90f107c5 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:07:05.967959 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-71a77b3b-ae89-4654-81d3-1b3a90f107c5 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1357 microversion: 2.1 time: 0.156549 Aug 31 10:07:05.968572 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 561/1138] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:07:05 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:07:06.990056 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-c55b8ae6-7b89-4548-a56b-9db10c79aab3 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:07:06.990746 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-c55b8ae6-7b89-4548-a56b-9db10c79aab3 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:07:06.996859 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c55b8ae6-7b89-4548-a56b-9db10c79aab3 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:06.997326 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c55b8ae6-7b89-4548-a56b-9db10c79aab3 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:06.997804 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c55b8ae6-7b89-4548-a56b-9db10c79aab3 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:06.999173 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c55b8ae6-7b89-4548-a56b-9db10c79aab3 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:06.999648 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c55b8ae6-7b89-4548-a56b-9db10c79aab3 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:07.000073 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-c55b8ae6-7b89-4548-a56b-9db10c79aab3 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:07.137463 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-c55b8ae6-7b89-4548-a56b-9db10c79aab3 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:07:07.145351 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-c55b8ae6-7b89-4548-a56b-9db10c79aab3 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1547 microversion: 2.1 time: 0.160030 Aug 31 10:07:07.145947 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 578/1139] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:07:06 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:07:07.165623 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-fac2da3e-ea0c-4fe5-9916-46d6fae923fe tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:07:07.166228 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-fac2da3e-ea0c-4fe5-9916-46d6fae923fe tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:07:07.173526 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fac2da3e-ea0c-4fe5-9916-46d6fae923fe tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:07.174011 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fac2da3e-ea0c-4fe5-9916-46d6fae923fe tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:07.174447 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fac2da3e-ea0c-4fe5-9916-46d6fae923fe tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:07.175119 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fac2da3e-ea0c-4fe5-9916-46d6fae923fe tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:07.175564 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fac2da3e-ea0c-4fe5-9916-46d6fae923fe tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:07.175981 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-fac2da3e-ea0c-4fe5-9916-46d6fae923fe tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:07.305329 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-fac2da3e-ea0c-4fe5-9916-46d6fae923fe tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:07:07.314705 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-fac2da3e-ea0c-4fe5-9916-46d6fae923fe tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1547 microversion: 2.1 time: 0.152903 Aug 31 10:07:07.315292 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 562/1140] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:07:07 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:07:07.334903 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-b7bd424e-7ea5-42d7-8726-65348d56be5e tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:07:07.339706 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-b7bd424e-7ea5-42d7-8726-65348d56be5e tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:07:07.340451 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-b7bd424e-7ea5-42d7-8726-65348d56be5e tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Searching by: {'deleted': False, 'project_id': '12a138e95d884fdaa8bb8653b151a546'} {{(pid=127170) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 10:07:07.347359 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b7bd424e-7ea5-42d7-8726-65348d56be5e tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:07.347831 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b7bd424e-7ea5-42d7-8726-65348d56be5e tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:07.348258 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b7bd424e-7ea5-42d7-8726-65348d56be5e tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:07.348967 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b7bd424e-7ea5-42d7-8726-65348d56be5e tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:07.349433 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b7bd424e-7ea5-42d7-8726-65348d56be5e tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:07.349851 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-b7bd424e-7ea5-42d7-8726-65348d56be5e tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:07.440887 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.multi_cell_list [None req-b7bd424e-7ea5-42d7-8726-65348d56be5e tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127170) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 10:07:07.534405 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-b7bd424e-7ea5-42d7-8726-65348d56be5e tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.203134 Aug 31 10:07:07.534913 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 579/1141] 10.222.0.13 () {58 vars in 1125 bytes} [Wed Aug 31 10:07:07 2022] GET /compute/v2.1/servers => generated 342 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:07:07.546939 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-5d4bf51c-30ba-4cd3-93e7-6c6f896d7318 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:07:07.547550 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-5d4bf51c-30ba-4cd3-93e7-6c6f896d7318 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:07:07.554411 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5d4bf51c-30ba-4cd3-93e7-6c6f896d7318 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:07.554890 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5d4bf51c-30ba-4cd3-93e7-6c6f896d7318 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:07.555321 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5d4bf51c-30ba-4cd3-93e7-6c6f896d7318 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:07.556064 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5d4bf51c-30ba-4cd3-93e7-6c6f896d7318 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:07.556466 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5d4bf51c-30ba-4cd3-93e7-6c6f896d7318 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:07.556874 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-5d4bf51c-30ba-4cd3-93e7-6c6f896d7318 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:07.686985 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-5d4bf51c-30ba-4cd3-93e7-6c6f896d7318 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:07:07.694921 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-5d4bf51c-30ba-4cd3-93e7-6c6f896d7318 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1547 microversion: 2.1 time: 0.152798 Aug 31 10:07:07.695499 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 563/1142] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:07:07 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:07:09.252068 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-36572916-d724-4541-af91-312df35f8f93 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c9b6832-64ec-420b-822d-407361623c69"}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:07:09.255045 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-36572916-d724-4541-af91-312df35f8f93 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:07:09.261528 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-36572916-d724-4541-af91-312df35f8f93 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:09.262001 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-36572916-d724-4541-af91-312df35f8f93 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:09.262559 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-36572916-d724-4541-af91-312df35f8f93 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:09.263240 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-36572916-d724-4541-af91-312df35f8f93 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:09.263681 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-36572916-d724-4541-af91-312df35f8f93 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:09.264148 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-36572916-d724-4541-af91-312df35f8f93 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:09.661437 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-36572916-d724-4541-af91-312df35f8f93 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "POST /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.414121 Aug 31 10:07:09.666595 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 580/1143] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 31 10:07:09 2022] POST /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892/os-volume_attachments => generated 194 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:07:17.242220 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-457107a9-ce0e-4768-a367-a80ba60045f6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:07:17.242782 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-457107a9-ce0e-4768-a367-a80ba60045f6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:07:17.245573 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:07:17.251040 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-457107a9-ce0e-4768-a367-a80ba60045f6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:17.251525 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-457107a9-ce0e-4768-a367-a80ba60045f6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:17.251962 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-457107a9-ce0e-4768-a367-a80ba60045f6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:17.252655 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-457107a9-ce0e-4768-a367-a80ba60045f6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:17.253112 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-457107a9-ce0e-4768-a367-a80ba60045f6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:17.253567 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-457107a9-ce0e-4768-a367-a80ba60045f6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:17.256963 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=71 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:07:17.385575 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-457107a9-ce0e-4768-a367-a80ba60045f6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:07:17.394580 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-457107a9-ce0e-4768-a367-a80ba60045f6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1593 microversion: 2.1 time: 0.156236 Aug 31 10:07:17.395195 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 564/1144] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:07:17 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1593 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:07:19.280863 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell0:SELECT=2 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:07:19.281859 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:07:19.348802 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-94acbd88-5307-4254-aa30-fcd01b816ace req-126072b0-6ea9-4640-8205-8c8285ce756a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2a1fcb7-e956-40e3-8a46-50b8e539f892", "tag": "c8a86a3c-f0ce-49da-85d1-df62974790f8"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:07:19.359560 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-94acbd88-5307-4254-aa30-fcd01b816ace req-126072b0-6ea9-4640-8205-8c8285ce756a service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:19.360046 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-94acbd88-5307-4254-aa30-fcd01b816ace req-126072b0-6ea9-4640-8205-8c8285ce756a service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:19.360609 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-94acbd88-5307-4254-aa30-fcd01b816ace req-126072b0-6ea9-4640-8205-8c8285ce756a service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:19.365821 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:07:19.374896 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-94acbd88-5307-4254-aa30-fcd01b816ace req-126072b0-6ea9-4640-8205-8c8285ce756a service nova] Creating event network-changed:c8a86a3c-f0ce-49da-85d1-df62974790f8 for instance d2a1fcb7-e956-40e3-8a46-50b8e539f892 on hv-cinder-84496 Aug 31 10:07:19.380624 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-94acbd88-5307-4254-aa30-fcd01b816ace req-126072b0-6ea9-4640-8205-8c8285ce756a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101161 Aug 31 10:07:19.381583 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 581/1145] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 10:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:07:20.389325 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-d7d6f2a7-f3c0-47f7-b53b-da43c7fc59cc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1113049985"}} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:07:20.390569 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-d7d6f2a7-f3c0-47f7-b53b-da43c7fc59cc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:07:20.397442 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d7d6f2a7-f3c0-47f7-b53b-da43c7fc59cc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:20.397928 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d7d6f2a7-f3c0-47f7-b53b-da43c7fc59cc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:20.398359 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d7d6f2a7-f3c0-47f7-b53b-da43c7fc59cc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:20.399052 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d7d6f2a7-f3c0-47f7-b53b-da43c7fc59cc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:20.399979 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d7d6f2a7-f3c0-47f7-b53b-da43c7fc59cc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:20.400403 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d7d6f2a7-f3c0-47f7-b53b-da43c7fc59cc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:20.528284 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.network.security_group_api [None req-d7d6f2a7-f3c0-47f7-b53b-da43c7fc59cc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Adding security group 0c9b1776-b2c7-4710-8c40-ef5046f45c39 to port c8a86a3c-f0ce-49da-85d1-df62974790f8 Aug 31 10:07:20.837724 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-d7d6f2a7-f3c0-47f7-b53b-da43c7fc59cc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "POST /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892/action" status: 202 len: 0 microversion: 2.1 time: 0.452364 Aug 31 10:07:20.838332 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 565/1146] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 31 10:07:20 2022] POST /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:07:20.849239 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-cbda8d2c-7112-4f23-8d8c-fe243f1fd378 req-92440de9-87ca-4356-a6ba-b70e0298acba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2a1fcb7-e956-40e3-8a46-50b8e539f892", "tag": "c8a86a3c-f0ce-49da-85d1-df62974790f8"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:07:20.861951 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-103f52c1-1ed3-4378-84db-e80c64cb162d tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:07:20.862570 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-103f52c1-1ed3-4378-84db-e80c64cb162d tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:07:20.867726 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-cbda8d2c-7112-4f23-8d8c-fe243f1fd378 req-92440de9-87ca-4356-a6ba-b70e0298acba service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:20.868212 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-cbda8d2c-7112-4f23-8d8c-fe243f1fd378 req-92440de9-87ca-4356-a6ba-b70e0298acba service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:20.868679 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-cbda8d2c-7112-4f23-8d8c-fe243f1fd378 req-92440de9-87ca-4356-a6ba-b70e0298acba service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:20.869429 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-103f52c1-1ed3-4378-84db-e80c64cb162d tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:20.870259 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-103f52c1-1ed3-4378-84db-e80c64cb162d tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:20.870644 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-103f52c1-1ed3-4378-84db-e80c64cb162d tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:20.871353 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-103f52c1-1ed3-4378-84db-e80c64cb162d tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:07:20.871806 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-103f52c1-1ed3-4378-84db-e80c64cb162d tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:07:20.872238 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-103f52c1-1ed3-4378-84db-e80c64cb162d tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:07:20.881842 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-cbda8d2c-7112-4f23-8d8c-fe243f1fd378 req-92440de9-87ca-4356-a6ba-b70e0298acba service nova] Creating event network-changed:c8a86a3c-f0ce-49da-85d1-df62974790f8 for instance d2a1fcb7-e956-40e3-8a46-50b8e539f892 on hv-cinder-84496 Aug 31 10:07:20.886732 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-cbda8d2c-7112-4f23-8d8c-fe243f1fd378 req-92440de9-87ca-4356-a6ba-b70e0298acba service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044234 Aug 31 10:07:20.887675 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 582/1147] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 10:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:07:21.115794 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-103f52c1-1ed3-4378-84db-e80c64cb162d tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:07:21.124306 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-103f52c1-1ed3-4378-84db-e80c64cb162d tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1759 microversion: 2.1 time: 0.278472 Aug 31 10:07:21.124885 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 566/1148] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:07:20 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1759 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:08:21.620523 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=4 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:08:21.621254 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=3 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:08:21.626311 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-92af0990-a883-4a5d-9ff6-d2d948ccca35 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:08:21.628575 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-92af0990-a883-4a5d-9ff6-d2d948ccca35 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:08:21.635475 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-92af0990-a883-4a5d-9ff6-d2d948ccca35 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:08:21.635950 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-92af0990-a883-4a5d-9ff6-d2d948ccca35 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:08:21.636428 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-92af0990-a883-4a5d-9ff6-d2d948ccca35 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:08:21.637106 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-92af0990-a883-4a5d-9ff6-d2d948ccca35 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:08:21.637588 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-92af0990-a883-4a5d-9ff6-d2d948ccca35 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:08:21.638006 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-92af0990-a883-4a5d-9ff6-d2d948ccca35 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:08:21.711354 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-92af0990-a883-4a5d-9ff6-d2d948ccca35 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "POST /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892/action" status: 202 len: 0 microversion: 2.1 time: 0.092570 Aug 31 10:08:21.711984 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 583/1149] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 31 10:08:21 2022] POST /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:08:21.718709 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=5 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:08:21.719464 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=15 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:08:21.724033 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-e041c282-e04f-421c-9e01-39720233c8fe tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:08:21.724650 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-e041c282-e04f-421c-9e01-39720233c8fe tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:08:21.732007 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e041c282-e04f-421c-9e01-39720233c8fe tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:08:21.732636 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e041c282-e04f-421c-9e01-39720233c8fe tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:08:21.733847 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e041c282-e04f-421c-9e01-39720233c8fe tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:08:21.734540 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e041c282-e04f-421c-9e01-39720233c8fe tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:08:21.734994 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e041c282-e04f-421c-9e01-39720233c8fe tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:08:21.735431 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-e041c282-e04f-421c-9e01-39720233c8fe tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:08:22.029832 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-e041c282-e04f-421c-9e01-39720233c8fe tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:08:22.038608 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-e041c282-e04f-421c-9e01-39720233c8fe tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1751 microversion: 2.1 time: 0.322328 Aug 31 10:08:22.039308 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 567/1150] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:08:21 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1751 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:08:23.061700 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-d740b635-6c9e-43b0-8f7f-de8e09dffa88 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:08:23.062725 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-d740b635-6c9e-43b0-8f7f-de8e09dffa88 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:08:23.069229 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d740b635-6c9e-43b0-8f7f-de8e09dffa88 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:08:23.069743 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d740b635-6c9e-43b0-8f7f-de8e09dffa88 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:08:23.070176 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d740b635-6c9e-43b0-8f7f-de8e09dffa88 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:08:23.070871 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d740b635-6c9e-43b0-8f7f-de8e09dffa88 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:08:23.071316 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d740b635-6c9e-43b0-8f7f-de8e09dffa88 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:08:23.071734 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-d740b635-6c9e-43b0-8f7f-de8e09dffa88 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:08:23.266769 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-d740b635-6c9e-43b0-8f7f-de8e09dffa88 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:08:23.275165 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-d740b635-6c9e-43b0-8f7f-de8e09dffa88 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1756 microversion: 2.1 time: 0.218712 Aug 31 10:08:23.275729 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 584/1151] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:08:23 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1756 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:08:24.297340 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-c93496f1-8325-45e9-96c6-1445beaefa46 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:08:24.298206 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-c93496f1-8325-45e9-96c6-1445beaefa46 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:08:24.304066 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c93496f1-8325-45e9-96c6-1445beaefa46 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:08:24.304549 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c93496f1-8325-45e9-96c6-1445beaefa46 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:08:24.304975 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c93496f1-8325-45e9-96c6-1445beaefa46 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:08:24.305699 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c93496f1-8325-45e9-96c6-1445beaefa46 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:08:24.306146 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c93496f1-8325-45e9-96c6-1445beaefa46 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:08:24.306562 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-c93496f1-8325-45e9-96c6-1445beaefa46 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:08:24.453692 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-c93496f1-8325-45e9-96c6-1445beaefa46 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:08:24.462020 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-c93496f1-8325-45e9-96c6-1445beaefa46 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1756 microversion: 2.1 time: 0.169340 Aug 31 10:08:24.462597 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 568/1152] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:08:24 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:08:25.485652 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-8744176b-7f49-4c04-9792-794030179bc4 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:08:25.486287 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-8744176b-7f49-4c04-9792-794030179bc4 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:08:25.488774 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 10:08:25.488902 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Wed Aug 31 10:08:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 (ip 10.222.0.13) !!! Aug 31 10:08:25.495676 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8744176b-7f49-4c04-9792-794030179bc4 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:08:25.496157 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8744176b-7f49-4c04-9792-794030179bc4 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:08:25.496586 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8744176b-7f49-4c04-9792-794030179bc4 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:08:25.497334 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8744176b-7f49-4c04-9792-794030179bc4 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:08:25.497886 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8744176b-7f49-4c04-9792-794030179bc4 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:08:25.498309 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-8744176b-7f49-4c04-9792-794030179bc4 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:08:25.639594 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-8744176b-7f49-4c04-9792-794030179bc4 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:08:25.647968 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-8744176b-7f49-4c04-9792-794030179bc4 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1756 microversion: 2.1 time: 0.167741 Aug 31 10:08:25.648537 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 585/1153] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:08:25 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:08:26.669049 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-2946871c-0cfa-41ed-bbba-fc50c68cdadc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:08:26.669738 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-2946871c-0cfa-41ed-bbba-fc50c68cdadc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:08:26.671789 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 10:08:26.672016 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: Wed Aug 31 10:08:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 (ip 10.222.0.13) !!! Aug 31 10:08:26.679513 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2946871c-0cfa-41ed-bbba-fc50c68cdadc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:08:26.679993 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2946871c-0cfa-41ed-bbba-fc50c68cdadc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:08:26.680426 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2946871c-0cfa-41ed-bbba-fc50c68cdadc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:08:26.681117 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2946871c-0cfa-41ed-bbba-fc50c68cdadc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:08:26.681596 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2946871c-0cfa-41ed-bbba-fc50c68cdadc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:08:26.682020 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-2946871c-0cfa-41ed-bbba-fc50c68cdadc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:08:26.830648 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-2946871c-0cfa-41ed-bbba-fc50c68cdadc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:08:26.839050 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-2946871c-0cfa-41ed-bbba-fc50c68cdadc tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1756 microversion: 2.1 time: 0.173913 Aug 31 10:08:26.839629 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 569/1154] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:08:26 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:08:27.860601 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-493bbb83-f245-4ebd-a70a-ccc5e5456585 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:08:27.861153 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-493bbb83-f245-4ebd-a70a-ccc5e5456585 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:08:27.867638 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-493bbb83-f245-4ebd-a70a-ccc5e5456585 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:08:27.868118 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-493bbb83-f245-4ebd-a70a-ccc5e5456585 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:08:27.868548 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-493bbb83-f245-4ebd-a70a-ccc5e5456585 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:08:27.869234 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-493bbb83-f245-4ebd-a70a-ccc5e5456585 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:08:27.869707 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-493bbb83-f245-4ebd-a70a-ccc5e5456585 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:08:27.870121 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-493bbb83-f245-4ebd-a70a-ccc5e5456585 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:08:28.019793 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-493bbb83-f245-4ebd-a70a-ccc5e5456585 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:08:28.027905 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-493bbb83-f245-4ebd-a70a-ccc5e5456585 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1756 microversion: 2.1 time: 0.171704 Aug 31 10:08:28.028464 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 586/1155] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:08:27 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:08:29.051067 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-eeaf61a0-8261-4b58-a55f-6337889ed520 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:08:29.051678 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-eeaf61a0-8261-4b58-a55f-6337889ed520 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:08:29.058137 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-eeaf61a0-8261-4b58-a55f-6337889ed520 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:08:29.058610 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-eeaf61a0-8261-4b58-a55f-6337889ed520 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:08:29.059040 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-eeaf61a0-8261-4b58-a55f-6337889ed520 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:08:29.059724 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-eeaf61a0-8261-4b58-a55f-6337889ed520 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:08:29.060168 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-eeaf61a0-8261-4b58-a55f-6337889ed520 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:08:29.060584 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-eeaf61a0-8261-4b58-a55f-6337889ed520 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:08:29.208545 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-eeaf61a0-8261-4b58-a55f-6337889ed520 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:08:29.216819 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-eeaf61a0-8261-4b58-a55f-6337889ed520 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1756 microversion: 2.1 time: 0.170394 Aug 31 10:08:29.217398 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 570/1156] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:08:29 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:08:30.238301 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-f1600c71-0c37-45fa-b56d-ee4a6122bbe6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:08:30.238857 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-f1600c71-0c37-45fa-b56d-ee4a6122bbe6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:08:30.245177 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f1600c71-0c37-45fa-b56d-ee4a6122bbe6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:08:30.245671 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f1600c71-0c37-45fa-b56d-ee4a6122bbe6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:08:30.246094 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f1600c71-0c37-45fa-b56d-ee4a6122bbe6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:08:30.246765 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f1600c71-0c37-45fa-b56d-ee4a6122bbe6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:08:30.247204 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f1600c71-0c37-45fa-b56d-ee4a6122bbe6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:08:30.247615 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-f1600c71-0c37-45fa-b56d-ee4a6122bbe6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:08:30.388637 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-f1600c71-0c37-45fa-b56d-ee4a6122bbe6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:08:30.398130 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-f1600c71-0c37-45fa-b56d-ee4a6122bbe6 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1756 microversion: 2.1 time: 0.163850 Aug 31 10:08:30.398706 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 587/1157] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:08:30 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:08:31.419509 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-23abd0e6-5e51-47ba-b6a0-b108a9e508a0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:08:31.420116 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-23abd0e6-5e51-47ba-b6a0-b108a9e508a0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:08:31.427276 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-23abd0e6-5e51-47ba-b6a0-b108a9e508a0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:08:31.427757 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-23abd0e6-5e51-47ba-b6a0-b108a9e508a0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:08:31.428189 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-23abd0e6-5e51-47ba-b6a0-b108a9e508a0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:08:31.428881 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-23abd0e6-5e51-47ba-b6a0-b108a9e508a0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:08:31.429357 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-23abd0e6-5e51-47ba-b6a0-b108a9e508a0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:08:31.429801 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-23abd0e6-5e51-47ba-b6a0-b108a9e508a0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:08:31.569493 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-23abd0e6-5e51-47ba-b6a0-b108a9e508a0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:08:31.577867 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-23abd0e6-5e51-47ba-b6a0-b108a9e508a0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1756 microversion: 2.1 time: 0.162129 Aug 31 10:08:31.578452 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 571/1158] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:08:31 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:08:32.599763 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-64c76bcf-3c0b-4f9e-ab1d-d5285052f416 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:08:32.600567 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-64c76bcf-3c0b-4f9e-ab1d-d5285052f416 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:08:32.606953 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-64c76bcf-3c0b-4f9e-ab1d-d5285052f416 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:08:32.607434 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-64c76bcf-3c0b-4f9e-ab1d-d5285052f416 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:08:32.608133 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-64c76bcf-3c0b-4f9e-ab1d-d5285052f416 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:08:32.608814 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-64c76bcf-3c0b-4f9e-ab1d-d5285052f416 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:08:32.609263 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-64c76bcf-3c0b-4f9e-ab1d-d5285052f416 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:08:32.609956 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-64c76bcf-3c0b-4f9e-ab1d-d5285052f416 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:08:32.758856 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-64c76bcf-3c0b-4f9e-ab1d-d5285052f416 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:08:32.767886 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-64c76bcf-3c0b-4f9e-ab1d-d5285052f416 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1756 microversion: 2.1 time: 0.172070 Aug 31 10:08:32.768453 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 588/1159] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:08:32 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:08:33.789677 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-a5d73d60-ef56-401f-b57c-38add1a6d425 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:08:33.790279 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-a5d73d60-ef56-401f-b57c-38add1a6d425 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:08:33.796792 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a5d73d60-ef56-401f-b57c-38add1a6d425 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:08:33.797271 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a5d73d60-ef56-401f-b57c-38add1a6d425 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:08:33.797732 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a5d73d60-ef56-401f-b57c-38add1a6d425 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:08:33.798414 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a5d73d60-ef56-401f-b57c-38add1a6d425 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:08:33.798860 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a5d73d60-ef56-401f-b57c-38add1a6d425 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:08:33.799274 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-a5d73d60-ef56-401f-b57c-38add1a6d425 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:08:33.940846 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-a5d73d60-ef56-401f-b57c-38add1a6d425 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:08:33.949033 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-a5d73d60-ef56-401f-b57c-38add1a6d425 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1759 microversion: 2.1 time: 0.163884 Aug 31 10:08:33.949634 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 572/1160] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:08:33 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:09:37.124488 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_api:SELECT=12 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:09:37.125259 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG dbcounter [-] [127170] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:09:37.129190 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-0c176f32-6389-4f4a-837e-a6bc0d4cebf0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1113049985"}} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:09:37.129738 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-0c176f32-6389-4f4a-837e-a6bc0d4cebf0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:09:37.138736 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0c176f32-6389-4f4a-837e-a6bc0d4cebf0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:09:37.139220 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0c176f32-6389-4f4a-837e-a6bc0d4cebf0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:09:37.139650 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0c176f32-6389-4f4a-837e-a6bc0d4cebf0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:09:37.140337 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0c176f32-6389-4f4a-837e-a6bc0d4cebf0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:09:37.140782 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0c176f32-6389-4f4a-837e-a6bc0d4cebf0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:09:37.141208 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-0c176f32-6389-4f4a-837e-a6bc0d4cebf0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:09:37.270603 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.network.security_group_api [None req-0c176f32-6389-4f4a-837e-a6bc0d4cebf0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Removing security group 0c9b1776-b2c7-4710-8c40-ef5046f45c39 from port c8a86a3c-f0ce-49da-85d1-df62974790f8 Aug 31 10:09:37.823454 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-0c176f32-6389-4f4a-837e-a6bc0d4cebf0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "POST /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892/action" status: 202 len: 0 microversion: 2.1 time: 0.700544 Aug 31 10:09:37.824090 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 589/1161] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 31 10:09:37 2022] POST /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892/action => generated 0 bytes in 702 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:09:37.831776 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_api:SELECT=12 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:09:37.832643 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG dbcounter [-] [127171] Writing DB stats nova_cell1:SELECT=36 {{(pid=127171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:09:37.838349 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-e80a3ea8-e9f5-4a9d-ae58-955a1164a985 req-1131ad4a-1461-45dc-9a91-4384bf38fcc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2a1fcb7-e956-40e3-8a46-50b8e539f892", "tag": "c8a86a3c-f0ce-49da-85d1-df62974790f8"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:09:37.848182 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-e80a3ea8-e9f5-4a9d-ae58-955a1164a985 req-1131ad4a-1461-45dc-9a91-4384bf38fcc2 service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:09:37.849052 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-e80a3ea8-e9f5-4a9d-ae58-955a1164a985 req-1131ad4a-1461-45dc-9a91-4384bf38fcc2 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:09:37.849792 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-e80a3ea8-e9f5-4a9d-ae58-955a1164a985 req-1131ad4a-1461-45dc-9a91-4384bf38fcc2 service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:09:37.865410 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-e80a3ea8-e9f5-4a9d-ae58-955a1164a985 req-1131ad4a-1461-45dc-9a91-4384bf38fcc2 service nova] Creating event network-changed:c8a86a3c-f0ce-49da-85d1-df62974790f8 for instance d2a1fcb7-e956-40e3-8a46-50b8e539f892 on hv-cinder-84496 Aug 31 10:09:37.871316 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-e80a3ea8-e9f5-4a9d-ae58-955a1164a985 req-1131ad4a-1461-45dc-9a91-4384bf38fcc2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041121 Aug 31 10:09:37.873101 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 573/1162] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 10:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:09:39.176912 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-99ef3e2a-9af5-496e-a51a-cb19586787f2 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:09:39.177509 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-99ef3e2a-9af5-496e-a51a-cb19586787f2 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:09:39.183366 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-99ef3e2a-9af5-496e-a51a-cb19586787f2 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:09:39.183844 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-99ef3e2a-9af5-496e-a51a-cb19586787f2 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:09:39.184269 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-99ef3e2a-9af5-496e-a51a-cb19586787f2 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:09:39.184948 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-99ef3e2a-9af5-496e-a51a-cb19586787f2 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:09:39.185403 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-99ef3e2a-9af5-496e-a51a-cb19586787f2 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:09:39.185825 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-99ef3e2a-9af5-496e-a51a-cb19586787f2 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:09:39.276023 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.objects.instance [None req-99ef3e2a-9af5-496e-a51a-cb19586787f2 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lazy-loading 'services' on Instance uuid d2a1fcb7-e956-40e3-8a46-50b8e539f892 {{(pid=127170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:09:39.364232 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-99ef3e2a-9af5-496e-a51a-cb19586787f2 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892/os-volume_attachments/5c9b6832-64ec-420b-822d-407361623c69" status: 202 len: 0 microversion: 2.1 time: 0.190419 Aug 31 10:09:39.368660 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 590/1163] 10.222.0.13 () {58 vars in 1416 bytes} [Wed Aug 31 10:09:39 2022] DELETE /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892/os-volume_attachments/5c9b6832-64ec-420b-822d-407361623c69 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:09:39.380483 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-d0963867-d777-4419-b0e7-cefc290e86a1 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:09:39.383913 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-d0963867-d777-4419-b0e7-cefc290e86a1 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:09:39.396681 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d0963867-d777-4419-b0e7-cefc290e86a1 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:09:39.397184 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d0963867-d777-4419-b0e7-cefc290e86a1 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:09:39.397657 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d0963867-d777-4419-b0e7-cefc290e86a1 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:09:39.398458 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d0963867-d777-4419-b0e7-cefc290e86a1 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:09:39.398911 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d0963867-d777-4419-b0e7-cefc290e86a1 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:09:39.399338 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-d0963867-d777-4419-b0e7-cefc290e86a1 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:09:39.447998 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-d0963867-d777-4419-b0e7-cefc290e86a1 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074661 Aug 31 10:09:39.449557 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 574/1164] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 31 10:09:39 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:09:39.891210 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [req-2131edf3-202d-4ddc-8fd4-d2113f42ed1b req-987b830a-8d16-4137-8ade-664a69b731ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2a1fcb7-e956-40e3-8a46-50b8e539f892", "tag": "c8a86a3c-f0ce-49da-85d1-df62974790f8"}]} {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:09:39.903329 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-2131edf3-202d-4ddc-8fd4-d2113f42ed1b req-987b830a-8d16-4137-8ade-664a69b731ad service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:09:39.903857 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-2131edf3-202d-4ddc-8fd4-d2113f42ed1b req-987b830a-8d16-4137-8ade-664a69b731ad service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:09:39.904495 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [req-2131edf3-202d-4ddc-8fd4-d2113f42ed1b req-987b830a-8d16-4137-8ade-664a69b731ad service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:09:39.918262 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.compute.server_external_events [req-2131edf3-202d-4ddc-8fd4-d2113f42ed1b req-987b830a-8d16-4137-8ade-664a69b731ad service nova] Creating event network-changed:c8a86a3c-f0ce-49da-85d1-df62974790f8 for instance d2a1fcb7-e956-40e3-8a46-50b8e539f892 on hv-cinder-84496 Aug 31 10:09:39.923693 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [req-2131edf3-202d-4ddc-8fd4-d2113f42ed1b req-987b830a-8d16-4137-8ade-664a69b731ad service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036456 Aug 31 10:09:39.924962 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 591/1165] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 10:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:09:40.463088 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-31f79833-8daa-483f-9923-edacdfac39e3 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:09:40.465322 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-31f79833-8daa-483f-9923-edacdfac39e3 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:09:40.472061 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-31f79833-8daa-483f-9923-edacdfac39e3 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:09:40.472555 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-31f79833-8daa-483f-9923-edacdfac39e3 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:09:40.472990 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-31f79833-8daa-483f-9923-edacdfac39e3 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:09:40.473945 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-31f79833-8daa-483f-9923-edacdfac39e3 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:09:40.474569 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-31f79833-8daa-483f-9923-edacdfac39e3 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:09:40.475356 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-31f79833-8daa-483f-9923-edacdfac39e3 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:09:40.513452 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-31f79833-8daa-483f-9923-edacdfac39e3 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054694 Aug 31 10:09:40.515114 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 575/1166] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 31 10:09:40 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 10:09:40.527636 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-59b550c5-31d6-4796-8111-3353dac0b560 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:09:40.528257 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-59b550c5-31d6-4796-8111-3353dac0b560 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:09:40.534798 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-59b550c5-31d6-4796-8111-3353dac0b560 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:09:40.535281 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-59b550c5-31d6-4796-8111-3353dac0b560 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:09:40.535714 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-59b550c5-31d6-4796-8111-3353dac0b560 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:09:40.536410 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-59b550c5-31d6-4796-8111-3353dac0b560 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:09:40.536863 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-59b550c5-31d6-4796-8111-3353dac0b560 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:09:40.537288 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-59b550c5-31d6-4796-8111-3353dac0b560 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:09:40.623255 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-59b550c5-31d6-4796-8111-3353dac0b560 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] HTTP exception thrown: Instance d2a1fcb7-e956-40e3-8a46-50b8e539f892 is not attached to volume 5c9b6832-64ec-420b-822d-407361623c69 Aug 31 10:09:40.625590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-59b550c5-31d6-4796-8111-3353dac0b560 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Request method failure captured: Aug 31 10:09:40.625590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: DELETE /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892/os-volume_attachments/5c9b6832-64ec-420b-822d-407361623c69 HTTP/1.1 Aug 31 10:09:40.625590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 10:09:40.625590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 10:09:40.625590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 10:09:40.625590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 10:09:40.625590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 10:09:40.625590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 10:09:40.625590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 10:09:40.625590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 10:09:40.625590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDzKmD34zgGTLENzLQuYyHb8ZPwiP4E05JO1fGsBcCb4-hCIdvrhEDvzB-x0sXoh2DQX7g327bSlM8UjB68mnl1Hl7GLmuyZxJZh3qEI5WjaZq72ucXbfsnOvQ5cTxWUm3RrasGf6FOwrpur9TVOMKmNG1geRCBqpFsJCgiEXVWUFmhk Aug 31 10:09:40.625590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 10:09:40.625590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 10:09:40.625590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 10:09:40.625590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 10:09:40.625590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 10:09:40.625590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 10:09:40.625590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: 12a138e95d884fdaa8bb8653b151a546 Aug 31 10:09:40.625590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-TestMinimumBasicScenario-161158237 Aug 31 10:09:40.625590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 10:09:40.625590 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 10:09:40.627392 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/12a138e95d884fdaa8bb8653b151a546"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/12a138e95d884fdaa8bb8653b151a546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/12a138e95d884fdaa8bb8653b151a546"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_12a138e95d884fdaa8bb8653b151a546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 10:09:40.627392 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-TestMinimumBasicScenario-161158237 Aug 31 10:09:40.627392 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: 12a138e95d884fdaa8bb8653b151a546 Aug 31 10:09:40.627392 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-TestMinimumBasicScenario-161158237 Aug 31 10:09:40.627392 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-TestMinimumBasicScenario-161158237-project Aug 31 10:09:40.627392 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 10:09:40.627392 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 10:09:40.627392 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: 2e8d67de6305464a982b7ad155a1ecca Aug 31 10:09:40.627392 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-TestMinimumBasicScenario-161158237-project Aug 31 10:09:40.627392 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 10:09:40.627392 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Instance d2a1fcb7-e956-40e3-8a46-50b8e539f892 is not attached to volume 5c9b6832-64ec-420b-822d-407361623c69 Aug 31 10:09:40.628384 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'server_id': 'd2a1fcb7-e956-40e3-8a46-50b8e539f892', 'id': '5c9b6832-64ec-420b-822d-407361623c69'} Aug 31 10:09:40.628384 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:09:40.628384 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:09:40.628384 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 10:09:40.628384 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 10:09:40.628384 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 10:09:40.628384 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 10:09:40.628384 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 10:09:40.628384 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 10:09:40.628384 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5c9b6832-64ec-420b-822d-407361623c69. Aug 31 10:09:40.628384 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:09:40.628384 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:09:40.628384 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:09:40.628384 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:09:40.628384 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:09:40.628384 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:09:40.628384 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:09:40.628384 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:09:40.628384 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:09:40.630175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:09:40.630175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 10:09:40.630175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 10:09:40.630175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2a1fcb7-e956-40e3-8a46-50b8e539f892 is not attached to volume 5c9b6832-64ec-420b-822d-407361623c69 Aug 31 10:09:40.630175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:09:40.630175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:09:40.630175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:09:40.630175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:09:40.630175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:09:40.630175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:09:40.630175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:09:40.630175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:09:40.630175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2a1fcb7-e956-40e3-8a46-50b8e539f892 is not attached to volume 5c9b6832-64ec-420b-822d-407361623c69 Aug 31 10:09:40.630175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:09:40.630175 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-59b550c5-31d6-4796-8111-3353dac0b560 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Returning 404 to user: Instance d2a1fcb7-e956-40e3-8a46-50b8e539f892 is not attached to volume 5c9b6832-64ec-420b-822d-407361623c69 {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:09:40.631403 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-59b550c5-31d6-4796-8111-3353dac0b560 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892/os-volume_attachments/5c9b6832-64ec-420b-822d-407361623c69" status: 404 len: 154 microversion: 2.1 time: 0.104650 Aug 31 10:09:40.631403 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 592/1167] 10.222.0.13 () {58 vars in 1416 bytes} [Wed Aug 31 10:09:40 2022] DELETE /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892/os-volume_attachments/5c9b6832-64ec-420b-822d-407361623c69 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:09:41.767630 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-8dd0dcc1-3f7d-42f2-b98f-e828f3a70295 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:09:41.768154 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-8dd0dcc1-3f7d-42f2-b98f-e828f3a70295 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:09:41.774824 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8dd0dcc1-3f7d-42f2-b98f-e828f3a70295 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:09:41.775297 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8dd0dcc1-3f7d-42f2-b98f-e828f3a70295 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:09:41.775733 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8dd0dcc1-3f7d-42f2-b98f-e828f3a70295 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:09:41.776422 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8dd0dcc1-3f7d-42f2-b98f-e828f3a70295 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:09:41.776872 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8dd0dcc1-3f7d-42f2-b98f-e828f3a70295 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:09:41.777291 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-8dd0dcc1-3f7d-42f2-b98f-e828f3a70295 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:09:41.802031 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-8dd0dcc1-3f7d-42f2-b98f-e828f3a70295 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Going to try to terminate instance {{(pid=127171) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 10:09:41.896737 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-8dd0dcc1-3f7d-42f2-b98f-e828f3a70295 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 204 len: 0 microversion: 2.1 time: 0.132730 Aug 31 10:09:41.897328 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 576/1168] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 31 10:09:41 2022] DELETE /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 10:09:41.905922 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-00f4425e-431c-495a-affc-99e096ae39b0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:09:41.906515 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-00f4425e-431c-495a-affc-99e096ae39b0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:09:41.913040 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-00f4425e-431c-495a-affc-99e096ae39b0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:09:41.913653 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-00f4425e-431c-495a-affc-99e096ae39b0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:09:41.914091 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-00f4425e-431c-495a-affc-99e096ae39b0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:09:41.914786 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-00f4425e-431c-495a-affc-99e096ae39b0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:09:41.915224 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-00f4425e-431c-495a-affc-99e096ae39b0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:09:41.915637 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-00f4425e-431c-495a-affc-99e096ae39b0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:09:42.059777 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-00f4425e-431c-495a-affc-99e096ae39b0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:09:42.068154 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-00f4425e-431c-495a-affc-99e096ae39b0 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1553 microversion: 2.1 time: 0.165939 Aug 31 10:09:42.070181 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 593/1169] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:09:41 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:09:43.095901 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-505241be-03ea-4290-bd92-f03da4d3da4e tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:09:43.096601 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.compute.api [None req-505241be-03ea-4290-bd92-f03da4d3da4e tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127171) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:09:43.104021 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-505241be-03ea-4290-bd92-f03da4d3da4e tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:09:43.104508 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-505241be-03ea-4290-bd92-f03da4d3da4e tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:09:43.104936 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-505241be-03ea-4290-bd92-f03da4d3da4e tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:09:43.105662 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-505241be-03ea-4290-bd92-f03da4d3da4e tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:09:43.106106 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-505241be-03ea-4290-bd92-f03da4d3da4e tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:09:43.106518 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [None req-505241be-03ea-4290-bd92-f03da4d3da4e tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:09:43.262536 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.policy [None req-505241be-03ea-4290-bd92-f03da4d3da4e tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127171) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:09:43.270376 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-505241be-03ea-4290-bd92-f03da4d3da4e tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1553 microversion: 2.1 time: 0.178716 Aug 31 10:09:43.270952 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 577/1170] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:09:43 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1553 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:09:44.292703 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-fe87ce01-ecb9-424c-bf85-eebc275004ac tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:09:44.293290 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-fe87ce01-ecb9-424c-bf85-eebc275004ac tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:09:44.299682 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fe87ce01-ecb9-424c-bf85-eebc275004ac tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:09:44.300156 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fe87ce01-ecb9-424c-bf85-eebc275004ac tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:09:44.300581 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fe87ce01-ecb9-424c-bf85-eebc275004ac tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:09:44.301257 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fe87ce01-ecb9-424c-bf85-eebc275004ac tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:09:44.301728 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fe87ce01-ecb9-424c-bf85-eebc275004ac tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:09:44.302140 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-fe87ce01-ecb9-424c-bf85-eebc275004ac tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:09:44.506513 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.policy [None req-fe87ce01-ecb9-424c-bf85-eebc275004ac tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8d67de6305464a982b7ad155a1ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a138e95d884fdaa8bb8653b151a546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127170) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:09:44.514982 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-fe87ce01-ecb9-424c-bf85-eebc275004ac tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 200 len: 1553 microversion: 2.1 time: 0.226698 Aug 31 10:09:44.515564 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 594/1171] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:09:44 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 1553 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:09:44.722089 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [req-2667bcec-fd18-4e2b-aff3-859c52bf47a6 req-bac177f9-4406-4782-b04f-3acedd30f14c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2a1fcb7-e956-40e3-8a46-50b8e539f892", "name": "network-vif-deleted", "tag": "c8a86a3c-f0ce-49da-85d1-df62974790f8"}]} {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:09:44.735858 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-2667bcec-fd18-4e2b-aff3-859c52bf47a6 req-bac177f9-4406-4782-b04f-3acedd30f14c service nova] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:09:44.736289 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-2667bcec-fd18-4e2b-aff3-859c52bf47a6 req-bac177f9-4406-4782-b04f-3acedd30f14c service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:09:44.736720 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG oslo_concurrency.lockutils [req-2667bcec-fd18-4e2b-aff3-859c52bf47a6 req-bac177f9-4406-4782-b04f-3acedd30f14c service nova] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:09:44.750272 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.compute.server_external_events [req-2667bcec-fd18-4e2b-aff3-859c52bf47a6 req-bac177f9-4406-4782-b04f-3acedd30f14c service nova] Creating event network-vif-deleted:c8a86a3c-f0ce-49da-85d1-df62974790f8 for instance d2a1fcb7-e956-40e3-8a46-50b8e539f892 on hv-cinder-84496 Aug 31 10:09:44.757857 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [req-2667bcec-fd18-4e2b-aff3-859c52bf47a6 req-bac177f9-4406-4782-b04f-3acedd30f14c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038632 Aug 31 10:09:44.758679 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 578/1172] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 31 10:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:09:45.536077 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-90d5cc43-b46c-4e2b-8e14-aacae6ee24d7 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '>' {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:09:45.536673 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.compute.api [None req-90d5cc43-b46c-4e2b-8e14-aacae6ee24d7 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] [instance: d2a1fcb7-e956-40e3-8a46-50b8e539f892] Fetching instance by UUID {{(pid=127170) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:09:45.543753 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-90d5cc43-b46c-4e2b-8e14-aacae6ee24d7 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:09:45.544232 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-90d5cc43-b46c-4e2b-8e14-aacae6ee24d7 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:09:45.544663 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-90d5cc43-b46c-4e2b-8e14-aacae6ee24d7 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:09:45.545349 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-90d5cc43-b46c-4e2b-8e14-aacae6ee24d7 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Acquiring lock "28536b87-4849-4a8b-a399-9479669b101c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:09:45.545819 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-90d5cc43-b46c-4e2b-8e14-aacae6ee24d7 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:09:45.546235 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG oslo_concurrency.lockutils [None req-90d5cc43-b46c-4e2b-8e14-aacae6ee24d7 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Lock "28536b87-4849-4a8b-a399-9479669b101c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:09:45.559408 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.wsgi [None req-90d5cc43-b46c-4e2b-8e14-aacae6ee24d7 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] HTTP exception thrown: Instance d2a1fcb7-e956-40e3-8a46-50b8e539f892 could not be found. Aug 31 10:09:45.560904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-90d5cc43-b46c-4e2b-8e14-aacae6ee24d7 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Request method failure captured: Aug 31 10:09:45.560904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: request: GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 HTTP/1.1 Aug 31 10:09:45.560904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept: application/json Aug 31 10:09:45.560904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Accept-Encoding: identity Aug 31 10:09:45.560904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Connection: close Aug 31 10:09:45.560904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Length: 0 Aug 31 10:09:45.560904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Content-Type: application/json Aug 31 10:09:45.560904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Host: 10.222.0.13 Aug 31 10:09:45.560904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: Openstack-System-Scope: None Aug 31 10:09:45.560904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: User-Agent: python-urllib3/1.26.12 Aug 31 10:09:45.560904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Auth-Token: gAAAAABjDzKmD34zgGTLENzLQuYyHb8ZPwiP4E05JO1fGsBcCb4-hCIdvrhEDvzB-x0sXoh2DQX7g327bSlM8UjB68mnl1Hl7GLmuyZxJZh3qEI5WjaZq72ucXbfsnOvQ5cTxWUm3RrasGf6FOwrpur9TVOMKmNG1geRCBqpFsJCgiEXVWUFmhk Aug 31 10:09:45.560904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Id: None Aug 31 10:09:45.560904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Domain-Name: None Aug 31 10:09:45.560904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Identity-Status: Confirmed Aug 31 10:09:45.560904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Is-Admin-Project: True Aug 31 10:09:45.560904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Id: default Aug 31 10:09:45.560904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Domain-Name: Default Aug 31 10:09:45.560904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Id: 12a138e95d884fdaa8bb8653b151a546 Aug 31 10:09:45.560904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Project-Name: tempest-TestMinimumBasicScenario-161158237 Aug 31 10:09:45.560904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Role: member,reader Aug 31 10:09:45.560904 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Roles: member,reader Aug 31 10:09:45.562655 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/12a138e95d884fdaa8bb8653b151a546"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/12a138e95d884fdaa8bb8653b151a546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/12a138e95d884fdaa8bb8653b151a546"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_12a138e95d884fdaa8bb8653b151a546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Aug 31 10:09:45.562655 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant: tempest-TestMinimumBasicScenario-161158237 Aug 31 10:09:45.562655 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Id: 12a138e95d884fdaa8bb8653b151a546 Aug 31 10:09:45.562655 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-Tenant-Name: tempest-TestMinimumBasicScenario-161158237 Aug 31 10:09:45.562655 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User: tempest-TestMinimumBasicScenario-161158237-project Aug 31 10:09:45.562655 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Id: default Aug 31 10:09:45.562655 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Domain-Name: Default Aug 31 10:09:45.562655 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Id: 2e8d67de6305464a982b7ad155a1ecca Aug 31 10:09:45.562655 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: X-User-Name: tempest-TestMinimumBasicScenario-161158237-project Aug 31 10:09:45.562655 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: method: > Aug 31 10:09:45.562655 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: exception: Instance d2a1fcb7-e956-40e3-8a46-50b8e539f892 could not be found. Aug 31 10:09:45.562655 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: action_args: {'id': 'd2a1fcb7-e956-40e3-8a46-50b8e539f892'} Aug 31 10:09:45.563664 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: {{(pid=127170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:09:45.563664 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:09:45.563664 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:09:45.563664 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:09:45.563664 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:09:45.563664 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:09:45.563664 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:09:45.563664 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:09:45.563664 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:09:45.563664 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:09:45.563664 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2a1fcb7-e956-40e3-8a46-50b8e539f892 could not be found. Aug 31 10:09:45.563664 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:09:45.563664 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:09:45.563664 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:09:45.563664 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:09:45.563664 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:09:45.563664 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:09:45.563664 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:09:45.563664 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:09:45.563664 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:09:45.565318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:09:45.565318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:09:45.565318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:09:45.565318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:09:45.565318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:09:45.565318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:09:45.565318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:09:45.565318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2a1fcb7-e956-40e3-8a46-50b8e539f892 could not be found. Aug 31 10:09:45.565318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:09:45.565318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:09:45.565318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:09:45.565318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:09:45.565318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:09:45.565318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:09:45.565318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:09:45.565318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:09:45.565318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2a1fcb7-e956-40e3-8a46-50b8e539f892 could not be found. Aug 31 10:09:45.565318 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: ERROR nova.api.openstack.wsgi Aug 31 10:09:45.566855 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: DEBUG nova.api.openstack.wsgi [None req-90d5cc43-b46c-4e2b-8e14-aacae6ee24d7 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Returning 404 to user: Instance d2a1fcb7-e956-40e3-8a46-50b8e539f892 could not be found. {{(pid=127170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:09:45.566855 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: INFO nova.api.openstack.requestlog [None req-90d5cc43-b46c-4e2b-8e14-aacae6ee24d7 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892" status: 404 len: 111 microversion: 2.1 time: 0.030166 Aug 31 10:09:45.566855 dv-cinder-844961-2-iscsi devstack@n-api.service[127170]: [pid: 127170|app: 0|req: 595/1173] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 31 10:09:45 2022] GET /compute/v2.1/servers/d2a1fcb7-e956-40e3-8a46-50b8e539f892 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:09:45.571631 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: DEBUG nova.api.openstack.wsgi [None req-a7abb9b4-620d-486c-a1fa-9a83511f0b89 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] Calling method '.version_select at 0x7f5503e7a550>' {{(pid=127171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:09:45.593354 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: INFO nova.api.openstack.requestlog [None req-a7abb9b4-620d-486c-a1fa-9a83511f0b89 tempest-TestMinimumBasicScenario-161158237 tempest-TestMinimumBasicScenario-161158237-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-786685181" status: 202 len: 0 microversion: 2.1 time: 0.025890 Aug 31 10:09:45.593959 dv-cinder-844961-2-iscsi devstack@n-api.service[127171]: [pid: 127171|app: 0|req: 579/1174] 10.222.0.13 () {58 vars in 1269 bytes} [Wed Aug 31 10:09:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-786685181 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)